-- Logs begin at Wed 2021-11-24 02:22:44 UTC, end at Wed 2021-11-24 03:26:01 UTC. -- Nov 24 02:55:30.195757 dv-cinder-818037-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 24 02:55:30.206508 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 24 02:55:30.208531 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 24 02:55:30 2021] *** Nov 24 02:55:30.208531 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 24 02:55:30.208531 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 24 02:55:30.208531 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: nodename: dv-cinder-818037-6-iscsi Nov 24 02:55:30.208531 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: machine: x86_64 Nov 24 02:55:30.208531 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: clock source: unix Nov 24 02:55:30.208531 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: pcre jit disabled Nov 24 02:55:30.208531 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: detected number of CPU cores: 4 Nov 24 02:55:30.208531 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: current working directory: / Nov 24 02:55:30.208531 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: detected binary path: /usr/bin/uwsgi-core Nov 24 02:55:30.208531 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: your processes number limit is 47680 Nov 24 02:55:30.208531 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: your memory page size is 4096 bytes Nov 24 02:55:30.208531 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: detected max file descriptor number: 2048 Nov 24 02:55:30.208531 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: lock engine: pthread robust mutexes Nov 24 02:55:30.209367 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: thunder lock: enabled Nov 24 02:55:30.209367 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 24 02:55:30.209367 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 24 02:55:30.255485 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: Python main interpreter initialized at 0x563ad1e2d9c0 Nov 24 02:55:30.255485 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: python threads support enabled Nov 24 02:55:30.255485 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: your server socket listen backlog is limited to 100 connections Nov 24 02:55:30.255485 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: your mercy for graceful operations on workers is 90 seconds Nov 24 02:55:30.255862 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: mapped 403077 bytes (393 KB) for 2 cores Nov 24 02:55:30.255862 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: *** Operational MODE: preforking *** Nov 24 02:55:30.256159 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: *** uWSGI is running in multiple interpreter mode *** Nov 24 02:55:30.256159 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: spawned uWSGI master process (pid: 102105) Nov 24 02:55:30.256402 dv-cinder-818037-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 24 02:55:30.257502 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: spawned uWSGI worker 1 (pid: 102106, cores: 1) Nov 24 02:55:30.257502 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: spawned uWSGI worker 2 (pid: 102107, cores: 1) Nov 24 02:55:30.257502 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 24 02:55:31.850917 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 02:55:31.850917 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: from cryptography.utils import int_from_bytes Nov 24 02:55:31.851625 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 02:55:31.851625 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: from cryptography.utils import int_from_bytes Nov 24 02:55:31.855887 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 02:55:31.855887 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: from cryptography.utils import int_from_bytes Nov 24 02:55:31.856438 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 02:55:31.856438 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: from cryptography.utils import int_from_bytes Nov 24 02:55:34.405746 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 02:55:34.406454 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 02:55:34.406539 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 02:55:34.406884 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 02:55:34.407141 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 02:55:34.407534 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.407860 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.408074 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 02:55:34.408458 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.408525 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 02:55:34.408588 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.408869 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 02:55:34.408974 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.409228 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 02:55:34.409418 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.409513 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 02:55:34.409870 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.410046 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.410225 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.410487 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.410586 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.410826 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.410926 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.411093 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.411310 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.411388 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.411463 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.411781 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.411913 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-6-iscsi {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.412091 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.412437 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.412531 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.412700 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.412869 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.413020 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.413179 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.413330 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-6-iscsi {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.413528 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.413659 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.413994 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.414107 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.414312 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.414595 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.414702 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.414929 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.415024 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.415254 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.415443 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.415569 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.415944 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.416127 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.416345 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.416542 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.416744 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.416893 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.417026 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.417215 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.417298 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.417527 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.417619 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.417853 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.417967 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.418195 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.418324 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.418519 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.418643 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.418832 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.418961 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.419166 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.419359 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-6-iscsi {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.419476 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.419561 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.419861 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.419945 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-6-iscsi {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.420181 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.420269 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.420498 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.420608 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.420815 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.420923 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.421234 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.421334 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.421551 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.421642 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.421867 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.422003 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.422208 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.422292 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.422540 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.422686 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.422850 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.423058 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.423178 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.423390 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.423500 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.423719 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.423811 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.424030 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.424137 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.424344 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.424437 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.424658 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.424827 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.424986 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.425142 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.425285 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.425440 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.425574 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.425716 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.425859 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.426064 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.426204 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.426347 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.426495 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.426649 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.426787 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.426944 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.427091 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.427248 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.427402 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.427538 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.427680 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.427818 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.427972 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.428092 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.428210 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.428527 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.428651 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.428842 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.429125 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.429226 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.429455 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.429670 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.429759 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.430079 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.430187 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.430393 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.430493 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.430707 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.430800 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.431029 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.431118 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.431397 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.431486 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.431771 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.431859 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.432153 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.432255 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.432485 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.432581 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.432867 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.432965 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.433139 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.433307 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.433456 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.433811 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.433988 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.434233 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.434362 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.434623 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.434869 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.434956 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.435193 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.435384 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.435531 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.435867 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.436043 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.436278 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.436409 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.436612 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.436760 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.436941 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.437111 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.437227 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.437319 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.437490 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.437636 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.437774 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.437871 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.438119 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.438252 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.438446 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.438591 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.438731 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.438888 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.439048 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.439145 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.439383 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.439577 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.439675 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.439756 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.439980 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.440112 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.440267 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.440427 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.440601 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.440734 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.440875 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.440971 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.441207 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.441339 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.441515 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.441687 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.441782 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.441860 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.442145 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.442277 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.442465 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.442597 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.442774 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.442916 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.443090 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.443221 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.443397 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.443529 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.443710 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.443840 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.444015 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.444146 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.444327 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.444458 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.444605 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.444706 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.444912 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.445010 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.445222 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.445314 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.445537 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.445664 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.445843 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.445959 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.446179 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.446267 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.446488 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.446583 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.446808 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.446908 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.447211 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.447345 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.447522 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.447701 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.447872 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.448067 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.448163 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.448436 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.448521 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.448756 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.448841 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.449068 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.449152 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.449376 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.449460 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.449689 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.449793 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.450012 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.450100 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.450321 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.450406 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.450632 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.450729 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.450938 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.451023 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.451247 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.451331 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.451550 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.451635 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.451857 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.451942 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.452164 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.452259 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.452475 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.452576 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.452781 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.452896 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.453087 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.453182 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.453389 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.453481 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.453712 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.453797 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.454059 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.454163 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.454375 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.454602 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.454694 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.454928 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.455019 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.455267 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.455362 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 02:55:34.455604 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.455727 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.455940 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.456131 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.456288 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.456609 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.456751 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.456943 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.457170 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.457336 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.457506 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.457645 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.457827 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.458064 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.458204 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.458367 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.458510 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.458661 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.458802 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.458893 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.459109 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.459257 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.459443 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.459602 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.459767 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.459891 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.460068 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.460356 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.460450 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.460692 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.460940 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.461025 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.461329 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.461502 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.461660 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.461950 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.462121 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.462286 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.462451 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.462658 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.462807 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.463041 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.463199 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.463366 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.463682 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.463769 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.464039 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.464122 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.464367 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.464559 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.464722 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.465062 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.465148 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.465394 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.465488 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.465860 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.466281 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.466474 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.466616 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.466951 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.467034 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.467278 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.467601 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.467755 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.467920 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.468195 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.468348 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.468572 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.468706 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.468890 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.469165 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.469356 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.469545 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.469692 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.469869 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.470126 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.470255 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.470510 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.470694 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.470823 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.471122 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.471318 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.471450 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.471625 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.471777 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.472061 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.472297 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.472430 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.472700 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.472832 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.473011 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.473324 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.473456 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.473640 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.473952 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.474089 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.474277 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.474533 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.474667 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.474887 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.475137 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.475287 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.475514 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.475647 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.475822 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.476150 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.476289 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.476463 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.476725 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.476859 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.477081 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.477283 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.477412 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.477693 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.477867 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.478043 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.478389 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.478524 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.478870 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.479032 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.479427 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.479623 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.480030 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.480171 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.480551 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.480728 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.481122 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.481305 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.481606 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.481864 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.482057 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.482299 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.482498 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.482633 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.482930 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.483076 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.483329 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.483651 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.483859 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.484182 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.484311 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.484511 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.484789 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.484924 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.485134 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.485417 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.485550 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.485844 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.486087 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.486291 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.486632 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.486791 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.487261 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.487674 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.487812 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.488197 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.488357 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.488506 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.488872 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.489041 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.489184 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.489423 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.489638 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.489869 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.490098 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.490239 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.490542 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.490627 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.490866 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.490951 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.491199 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.491360 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.491565 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.491711 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.491826 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.491978 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.492129 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.492238 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.492436 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.492529 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.492765 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.492859 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.493087 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.493175 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.493415 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.493519 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.493730 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.493891 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.494286 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.494467 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.494793 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.494953 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.495219 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.495318 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.495531 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.495764 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.495876 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.496229 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.496362 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.496580 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.496837 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.496922 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.497224 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.497382 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.497547 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.497871 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.497978 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.498216 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.498536 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.498610 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.498853 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.499147 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.499224 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.499485 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.499761 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.499849 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.500115 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.500360 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.500437 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.500748 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.500969 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.501065 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.501392 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.501573 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.501704 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.502063 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.502207 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.502402 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.502741 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.502816 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.503059 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.503413 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.503488 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.503770 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.504040 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.504117 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.504395 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.504653 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.504820 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.505010 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.505285 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.505374 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.505619 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.505877 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.505982 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.506273 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.506450 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.506589 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.506901 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.506986 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.507222 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.507479 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.507562 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.507833 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.508060 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.508135 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.508441 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.508609 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.508767 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.509083 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.509171 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.509410 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.509833 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.510048 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.510189 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.510420 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.510547 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.510920 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.511446 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.511608 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.511911 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.512033 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.512449 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.512593 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.513029 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.513180 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.513609 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.513760 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.514265 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.514425 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.514881 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.515019 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.515374 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.515484 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.515868 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.516054 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.516427 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.516670 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.516945 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.517257 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.517517 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.517856 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.518136 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.518825 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.519102 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.519411 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.519738 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.520024 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.520274 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.520622 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.520830 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.521187 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.521290 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.521589 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.521749 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.522000 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.522271 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.522389 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.522594 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.522870 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.523023 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.523390 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.523513 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.523900 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.524021 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.524325 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.524449 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.524749 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.524870 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.525106 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.525323 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.525621 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.525760 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.526256 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.526391 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.526596 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.526915 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.527037 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.527314 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.527679 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.527926 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.528183 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.528462 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.528622 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.529009 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.529154 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.529500 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.529623 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.530050 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.530243 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.530511 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.530662 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.531014 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.531226 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.531520 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.531782 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.532031 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.532328 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.532537 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.532882 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.533010 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.533417 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.533539 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.534007 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.534133 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.534476 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.534609 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.534995 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.535120 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.535482 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.535671 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.535973 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.536254 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.536500 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.536797 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.537024 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.537342 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.537617 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.537808 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.538171 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.538321 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.538517 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.538706 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.538856 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.539151 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.539274 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.539590 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.539731 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.540055 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.540199 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.540547 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.540706 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.541071 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.541210 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.541650 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.542057 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.542202 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.542326 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.542590 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.542813 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.543042 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.543457 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.543592 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.543934 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.544058 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.544411 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.544552 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.544966 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.545307 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.545450 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.545871 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.546022 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.546322 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.546446 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.546804 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.546926 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.547254 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.547451 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.547678 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.547976 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.548160 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.548531 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.548659 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.549048 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.549211 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.549543 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.549677 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.550066 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.550224 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.550476 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.550625 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.550939 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.551073 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.551394 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.551518 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.551839 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.551976 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.552298 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.552420 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.552757 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.552944 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.553198 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.553336 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.553644 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.553780 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.554113 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.554241 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.554554 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.554676 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.555045 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.555185 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.555470 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.555594 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.555906 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.556050 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.556517 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.556699 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.556887 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.557051 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.557335 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.557581 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.557809 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.558064 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.558290 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.558530 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.558730 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.559028 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.559164 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.559538 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.559661 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.559953 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.560087 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.560349 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.560504 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.560861 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.560984 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.561386 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.561529 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.561825 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.561994 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.562260 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.562383 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.562729 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.562922 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.563203 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.563389 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.563658 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.563780 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.564094 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.564219 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.564532 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.564667 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.564975 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.565099 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.565410 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.565531 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.565842 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.566044 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.566313 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.566437 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.566734 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.566866 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.567186 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.567309 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.567634 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.567757 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.568076 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.568250 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.568523 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.568783 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.568972 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.569305 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.569427 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.569819 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.569983 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.570315 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.570452 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.570751 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.570876 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.571198 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.571424 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.571640 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.571927 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.572089 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.572523 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.572670 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.572967 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.573110 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.573549 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.573795 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.574026 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.574250 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.574470 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.574887 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.575042 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.575347 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.575473 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.575792 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.575997 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.576229 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.576600 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.576752 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.577144 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.577299 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.577581 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.577734 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.578053 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.578308 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.578498 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.578864 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.578996 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.579367 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.579503 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.579820 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.579987 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.580292 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.580563 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.580755 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.581119 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.581276 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.581642 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.581772 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.582115 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.582256 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.582566 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.582820 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.583077 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.583384 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.583573 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.583951 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.584110 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.584380 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.584534 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.584817 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.585124 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.585272 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.585667 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.585789 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.586165 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.586291 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.586613 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.586819 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.587052 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.587383 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.587505 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.587992 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.588168 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.588497 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.588641 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.588931 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.589124 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.589445 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.589696 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.589889 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.590290 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.590414 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.590819 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.590954 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.591283 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.591405 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.591738 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.591961 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.592195 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.592523 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.592661 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.593085 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.593218 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.593598 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.593726 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.594200 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.594332 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.594675 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.594799 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.595149 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.595328 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.595629 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.595900 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.596089 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.596455 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.596579 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.597025 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.597165 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.597556 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.597687 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.598121 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.598393 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.598621 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.598958 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.599089 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.599529 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.599652 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.600088 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.600224 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.600650 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.600771 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.601216 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.601348 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.601779 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.602007 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.602375 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.602526 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.602927 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.603057 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.603580 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.603752 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.604128 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.604302 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.604642 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.604850 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.605152 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.605429 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.605599 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.606039 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.606192 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.606598 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.606750 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.607067 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.607194 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.607536 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.607729 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.608010 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.608283 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.608488 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.608862 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.609002 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.609421 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.609557 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.610034 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.610165 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.610571 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.610709 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.611028 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.611588 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.611788 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.611955 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.612081 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.612362 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.612518 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.612817 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.613003 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.613279 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.613731 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.613885 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.614338 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.614504 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.614818 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.614969 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.615275 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.615482 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.615729 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.616038 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.616164 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.616606 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.616728 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.617058 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.617182 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.617528 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.617726 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.617998 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.618325 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.618459 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.618907 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.619064 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.619381 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.619690 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.619821 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.620258 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.620426 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.620781 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.620908 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.621106 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.621376 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.621507 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.621837 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.622013 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.622252 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.622565 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.622688 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.623129 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.623270 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.623600 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.623723 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.624069 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.624461 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.624604 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.624957 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.625079 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.625408 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.625598 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.625871 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.626198 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.626367 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.626786 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.626909 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.627261 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.627397 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.627704 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.627878 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.628186 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.628443 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.628658 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.628999 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.629130 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.629552 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.629866 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.630160 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.630285 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.630652 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.630774 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.631103 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.631272 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.631574 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.631839 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.632045 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.632406 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.632542 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.632913 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.633045 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.633366 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.633501 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.633805 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.634092 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.634279 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.634825 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.635032 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.635275 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.635635 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.635834 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.636159 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.636292 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.636611 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.636766 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.637059 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.637366 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.637540 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.637950 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.638086 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.638468 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.638613 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.638894 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.639093 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.639362 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.639663 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.639849 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.640232 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.640395 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.640790 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.640927 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.641272 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.641413 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.641755 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.641997 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.642191 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.642509 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.642594 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.642822 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.643169 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.643637 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.644100 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.644219 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.644496 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.644659 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.644977 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.645269 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.645410 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.645664 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.645938 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.646132 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.646465 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.646552 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.646795 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.647033 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.647128 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.647442 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.647616 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.647763 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.648076 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.648175 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.648395 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.648710 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.648798 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.649139 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.649277 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.649653 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.649830 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.650248 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.650464 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.650768 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.651045 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.651271 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.651610 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.651797 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.652162 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.652308 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.652714 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.652801 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.653267 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.653361 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.653790 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.653884 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.654380 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.654470 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.654970 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.655058 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.655450 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.655540 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.656140 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.656249 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.656601 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.656694 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.657163 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.657249 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.657675 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.657771 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.658064 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.658348 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.658467 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.658792 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.658956 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.659130 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.659458 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.659543 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.659784 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.660105 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.660191 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.660427 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.660703 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.660792 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.661057 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.661267 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.661384 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.661699 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.661852 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.662045 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.662366 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.662464 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.662773 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.663009 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.663570 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.663656 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.664044 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.664141 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.664504 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.664686 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.664955 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.665312 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.665401 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.665904 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.666159 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.666420 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.666557 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.666824 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.667029 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.667285 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.667607 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.667782 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.668142 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.668297 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.668655 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.669127 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.669291 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.669602 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.669748 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.670114 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.670293 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.670580 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.670867 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.671037 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.671437 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.671531 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.671946 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.672099 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.672466 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.672624 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.672919 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.673021 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.673365 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.673543 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.673824 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.674033 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.674449 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.674610 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.674926 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.675073 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.675298 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.675443 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.675650 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.675816 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.676065 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.676405 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.676658 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.676743 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.677182 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.677279 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.677646 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.677801 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.678135 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.678424 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.678602 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.679073 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.679160 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.679556 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.679643 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.680024 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.680182 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.680481 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.680756 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.680936 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.681364 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.681458 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.682000 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.682251 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.682718 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.683167 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.683511 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.683621 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.683851 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.684166 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.684257 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.684498 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.684751 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.684865 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.685143 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.685334 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.685456 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.685779 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.685900 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.686152 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.686471 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.686622 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.686802 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.687092 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.687226 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.687422 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.687672 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.687814 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.688060 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.688261 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.688615 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.688870 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.689001 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.689284 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.689455 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.689618 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.689898 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.690107 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.690446 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.691289 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.691614 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.691958 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.692125 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.692266 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.692589 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.692739 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.692913 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.693037 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.693234 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.693432 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.693535 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.693834 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.694078 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.694236 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.694385 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.694561 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.694706 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.694928 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.695062 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.695211 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.695376 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.695600 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.695701 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.696009 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.696122 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.696427 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.696596 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.697066 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.697218 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.698048 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.698221 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.698308 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.698308 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.698458 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.698543 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.698750 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.698942 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.699084 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.699388 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.699522 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.699807 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.700049 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.700248 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.700639 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.700746 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.701179 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.701318 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.701653 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.702163 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.702320 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.703195 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.703341 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.703435 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.703567 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.703567 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.703734 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.703862 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.704000 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.704088 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.704412 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.704545 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.704744 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.706244 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.706348 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.706458 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.706604 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.706728 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.706852 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.706967 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.707198 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.707306 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.707306 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.707584 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.707724 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.707844 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.707981 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.708129 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.708428 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.708428 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.709191 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.709313 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.709396 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.709526 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.709526 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.709713 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.709782 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.711261 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.711413 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.711413 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.711664 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.711790 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.711790 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.712009 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.712124 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.712241 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.712351 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.712438 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.712783 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.712783 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.713190 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.713329 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.713461 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.713573 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.713655 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.713748 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.713748 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.714021 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.714155 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.714277 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.714433 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.714433 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.714697 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.714822 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.714916 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.715024 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.715024 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.715314 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.715445 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.715631 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.715998 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.716322 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.716505 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.716695 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.716875 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.716953 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.717033 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.717230 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.717450 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.717577 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.717773 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.718077 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.718365 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.718674 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.718829 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.719071 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.719202 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.719424 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.719577 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.719773 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.719930 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.720086 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.720200 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.720404 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.720716 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.720804 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.721046 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.721309 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.721418 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.721640 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.721742 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.721996 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.722119 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.722315 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.722633 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.722769 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.722950 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.723220 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.723351 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.723569 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.723759 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.723890 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.724195 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.724320 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.724544 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.724858 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.724988 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.725244 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.725418 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.725554 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.725808 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.725988 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.726149 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.726464 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.726576 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.726781 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.727092 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.727179 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.727424 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.727717 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.727817 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.728060 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.728335 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.728485 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.728862 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.729008 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.729402 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.729557 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.729753 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.729983 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.730100 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.730503 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.730676 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.730915 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.731039 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.731277 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.731398 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.731613 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.731752 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.731958 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.732101 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.732276 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.732425 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.732612 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.732823 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.732969 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.733252 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.733435 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.733588 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.733946 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.734045 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.734261 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.734619 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.734728 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.734973 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.735110 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.735239 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.735374 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.735566 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.735703 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.735923 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.736108 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.736244 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.736563 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.736701 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.736898 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.737238 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.737354 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.737552 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.737688 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.737887 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.738081 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.738257 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.738402 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.738584 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.738715 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.738910 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.739060 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.739224 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.739351 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.739561 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.739675 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.739879 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.740022 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.740202 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.740321 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.740518 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.740639 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.740834 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.740975 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.741161 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.741295 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.741481 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.741609 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.741812 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.742002 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.742150 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.742275 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.742707 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.742899 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.743048 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.743235 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.743365 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.743595 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.743751 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.744011 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.744174 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.744365 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.744604 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.744758 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.745158 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.745327 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.745511 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.745667 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.745839 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.746044 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.746197 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 02:55:34.746374 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.746629 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.746965 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.747285 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.747612 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.747936 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.748262 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.748594 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.748933 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.749268 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.749600 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.749976 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.750305 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.750660 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.750994 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.751315 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.751633 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.751944 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 02:55:34.752194 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 02:55:34.775774 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG oslo_db.sqlalchemy.engines [None req-f23d5857-5709-4000-9ab9-589f8ed1347f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102107) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 02:55:34.785708 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_db.sqlalchemy.engines [None req-3a71b76c-125f-4e99-bf90-64f635182e6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 02:55:34.868078 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.context [None req-3a71b76c-125f-4e99-bf90-64f635182e6f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7bf0cf92-00d1-4d68-9678-23382842fbe7(cell1) {{(pid=102106) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 02:55:34.873730 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-3a71b76c-125f-4e99-bf90-64f635182e6f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 02:55:34.875647 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-3a71b76c-125f-4e99-bf90-64f635182e6f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 02:55:34.876361 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.context [None req-f23d5857-5709-4000-9ab9-589f8ed1347f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7bf0cf92-00d1-4d68-9678-23382842fbe7(cell1) {{(pid=102107) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 02:55:34.876648 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-3a71b76c-125f-4e99-bf90-64f635182e6f None None] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 02:55:34.878837 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-3a71b76c-125f-4e99-bf90-64f635182e6f None None] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 02:55:34.880714 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG oslo_concurrency.lockutils [None req-f23d5857-5709-4000-9ab9-589f8ed1347f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 02:55:34.882361 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG oslo_concurrency.lockutils [None req-f23d5857-5709-4000-9ab9-589f8ed1347f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 02:55:34.883231 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG oslo_concurrency.lockutils [None req-f23d5857-5709-4000-9ab9-589f8ed1347f None None] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 02:55:34.885619 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG oslo_concurrency.lockutils [None req-f23d5857-5709-4000-9ab9-589f8ed1347f None None] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 02:55:34.895507 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_db.sqlalchemy.engines [None req-3a71b76c-125f-4e99-bf90-64f635182e6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 02:55:34.899024 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_db.sqlalchemy.engines [None req-3a71b76c-125f-4e99-bf90-64f635182e6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 02:55:34.905521 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG oslo_db.sqlalchemy.engines [None req-f23d5857-5709-4000-9ab9-589f8ed1347f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102107) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 02:55:34.911029 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG oslo_db.sqlalchemy.engines [None req-f23d5857-5709-4000-9ab9-589f8ed1347f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102107) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 02:55:35.222564 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_db.sqlalchemy.engines [None req-3a71b76c-125f-4e99-bf90-64f635182e6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 02:55:35.230161 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG oslo_db.sqlalchemy.engines [None req-f23d5857-5709-4000-9ab9-589f8ed1347f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102107) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 02:55:35.801059 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: WARNING keystonemiddleware.auth_token [None req-3a71b76c-125f-4e99-bf90-64f635182e6f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 02:55:35.802648 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: WARNING keystonemiddleware.auth_token [None req-f23d5857-5709-4000-9ab9-589f8ed1347f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 02:55:35.813302 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: WARNING keystonemiddleware.auth_token [None req-3a71b76c-125f-4e99-bf90-64f635182e6f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 02:55:35.814757 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: WARNING keystonemiddleware.auth_token [None req-f23d5857-5709-4000-9ab9-589f8ed1347f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 02:55:36.208916 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: WARNING keystonemiddleware.auth_token [None req-3a71b76c-125f-4e99-bf90-64f635182e6f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 02:55:36.210150 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: WARNING keystonemiddleware.auth_token [None req-f23d5857-5709-4000-9ab9-589f8ed1347f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 02:55:36.218391 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: WARNING keystonemiddleware.auth_token [None req-3a71b76c-125f-4e99-bf90-64f635182e6f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 02:55:36.219338 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: WARNING keystonemiddleware.auth_token [None req-f23d5857-5709-4000-9ab9-589f8ed1347f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 02:55:36.228216 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563ad1e2d9c0 pid: 102106 (default app) Nov 24 02:55:36.229617 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563ad1e2d9c0 pid: 102107 (default app) Nov 24 02:55:36.231170 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-3a71b76c-125f-4e99-bf90-64f635182e6f None None] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:55:36.232369 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-3a71b76c-125f-4e99-bf90-64f635182e6f None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001919 Nov 24 02:55:36.233237 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Wed Nov 24 02:55:36 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:57:03.999652 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-f23d5857-5709-4000-9ab9-589f8ed1347f None None] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:57:04.002784 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-f23d5857-5709-4000-9ab9-589f8ed1347f None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004558 Nov 24 02:57:04.007054 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 930 bytes} [Wed Nov 24 02:57:03 2021] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:57:04.637857 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-a0d38c6f-8f43-4b28-8df3-bd8226a98858 admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:57:04.673076 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-a0d38c6f-8f43-4b28-8df3-bd8226a98858 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.658238 Nov 24 02:57:04.682387 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 2/3] 10.222.0.52 () {60 vars in 1291 bytes} [Wed Nov 24 02:57:04 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 02:57:07.256826 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-f23d5857-5709-4000-9ab9-589f8ed1347f None None] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:57:07.258192 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-f23d5857-5709-4000-9ab9-589f8ed1347f None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002010 Nov 24 02:57:07.258810 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 2/4] 10.222.0.52 () {54 vars in 930 bytes} [Wed Nov 24 02:57:07 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 02:57:07.351813 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-c46257c3-bd3e-4a62-a93f-a7dfee006f85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "ram": 256, "rxtx_factor": 1.0, "name": "cirros256"}} {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:07.388294 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 02:57:07.388294 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: warnings.warn(msg) Nov 24 02:57:07.448924 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-c46257c3-bd3e-4a62-a93f-a7dfee006f85 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.180345 Nov 24 02:57:07.450260 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 3/5] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Nov 24 02:57:07 2021] POST /compute/v2.1/flavors => generated 407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 02:57:07.883696 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-d84708d0-e9a7-4e43-b624-868d12970e46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:07.886333 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 02:57:07.886333 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: warnings.warn(msg) Nov 24 02:57:07.951864 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-d84708d0-e9a7-4e43-b624-868d12970e46 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.485761 Nov 24 02:57:07.967019 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 3/6] 10.222.0.52 () {64 vars in 1335 bytes} [Wed Nov 24 02:57:07 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 02:57:10.440432 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-c46257c3-bd3e-4a62-a93f-a7dfee006f85 admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:57:10.442677 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-c46257c3-bd3e-4a62-a93f-a7dfee006f85 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002986 Nov 24 02:57:10.443992 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 4/7] 10.222.0.52 () {54 vars in 930 bytes} [Wed Nov 24 02:57:10 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:57:10.598924 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-80e54d1a-e37c-4002-b176-fa5262744a70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "ds512M", "id": "d1", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "vcpus": 1}} {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:10.630698 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 02:57:10.630698 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: warnings.warn(msg) Nov 24 02:57:10.664109 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-80e54d1a-e37c-4002-b176-fa5262744a70 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.207202 Nov 24 02:57:10.665220 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 4/8] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Nov 24 02:57:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 02:57:10.680783 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-8a33d89b-d2de-4b4d-9edc-fdda2eaef8eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:10.682997 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 02:57:10.682997 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: warnings.warn(msg) Nov 24 02:57:10.732112 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-8a33d89b-d2de-4b4d-9edc-fdda2eaef8eb admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056014 Nov 24 02:57:10.734111 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 5/9] 10.222.0.52 () {64 vars in 1335 bytes} [Wed Nov 24 02:57:10 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 02:57:13.223671 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-80e54d1a-e37c-4002-b176-fa5262744a70 admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:57:13.225060 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-80e54d1a-e37c-4002-b176-fa5262744a70 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Nov 24 02:57:13.229442 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 930 bytes} [Wed Nov 24 02:57:13 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:57:13.300751 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-6750b1de-3ea8-469a-89c9-ee074b9e06cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:13.321249 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-6750b1de-3ea8-469a-89c9-ee074b9e06cf admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.088805 Nov 24 02:57:13.321834 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 6/11] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Nov 24 02:57:13 2021] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 02:57:13.339331 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-82ca36ca-e0b7-4794-b4e0-e318c57488b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:13.380768 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-82ca36ca-e0b7-4794-b4e0-e318c57488b1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048524 Nov 24 02:57:13.382049 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 6/12] 10.222.0.52 () {64 vars in 1335 bytes} [Wed Nov 24 02:57:13 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 02:57:16.003288 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-6750b1de-3ea8-469a-89c9-ee074b9e06cf admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:57:16.004298 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-6750b1de-3ea8-469a-89c9-ee074b9e06cf admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Nov 24 02:57:16.004703 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 7/13] 10.222.0.52 () {54 vars in 930 bytes} [Wed Nov 24 02:57:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:57:16.072269 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-e1a7ec56-c54b-4a22-8ee7-5f6db6d8315a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10, "name": "ds2G", "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:16.094403 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-e1a7ec56-c54b-4a22-8ee7-5f6db6d8315a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082670 Nov 24 02:57:16.095544 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 7/14] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Nov 24 02:57:16 2021] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 02:57:16.110126 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-909beba6-b417-4123-a53c-a55ef4f8332d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:16.136154 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-909beba6-b417-4123-a53c-a55ef4f8332d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030089 Nov 24 02:57:16.136784 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 8/15] 10.222.0.52 () {64 vars in 1335 bytes} [Wed Nov 24 02:57:16 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 02:57:18.832747 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-e1a7ec56-c54b-4a22-8ee7-5f6db6d8315a admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:57:18.832747 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-e1a7ec56-c54b-4a22-8ee7-5f6db6d8315a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Nov 24 02:57:18.832747 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 8/16] 10.222.0.52 () {54 vars in 930 bytes} [Wed Nov 24 02:57:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:57:18.899491 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-093a649e-1faa-434e-93ca-a2af1d792357 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "vcpus": 4, "id": "d4", "swap": 0, "disk": 20}} {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:18.922849 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-093a649e-1faa-434e-93ca-a2af1d792357 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081233 Nov 24 02:57:18.923834 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 9/17] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Nov 24 02:57:18 2021] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 02:57:18.936672 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-0c371331-a792-4f60-9050-02ebd41b108f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:18.963367 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-0c371331-a792-4f60-9050-02ebd41b108f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030338 Nov 24 02:57:18.963962 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 9/18] 10.222.0.52 () {64 vars in 1335 bytes} [Wed Nov 24 02:57:18 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 02:57:21.441076 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-093a649e-1faa-434e-93ca-a2af1d792357 admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:57:21.442217 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-093a649e-1faa-434e-93ca-a2af1d792357 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001633 Nov 24 02:57:21.442629 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 10/19] 10.222.0.52 () {54 vars in 930 bytes} [Wed Nov 24 02:57:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:57:21.519052 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-341358ea-7c89-47db-805a-884c59fc1162 admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:57:21.546993 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-341358ea-7c89-47db-805a-884c59fc1162 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.097029 Nov 24 02:57:21.547603 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 10/20] 10.222.0.52 () {60 vars in 1291 bytes} [Wed Nov 24 02:57:21 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 02:57:23.951875 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-093a649e-1faa-434e-93ca-a2af1d792357 admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:57:23.952948 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-093a649e-1faa-434e-93ca-a2af1d792357 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Nov 24 02:57:23.953366 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 11/21] 10.222.0.52 () {54 vars in 930 bytes} [Wed Nov 24 02:57:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:57:24.023870 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-de38ac7e-f4e8-4180-86bb-0e1fc396aa0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "swap": 0, "vcpus": 1, "name": "m1.tiny", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1"}} {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:24.046722 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-de38ac7e-f4e8-4180-86bb-0e1fc396aa0a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.085377 Nov 24 02:57:24.047339 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 11/22] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Nov 24 02:57:23 2021] POST /compute/v2.1/flavors => generated 402 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 02:57:24.061743 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-f4b86d5b-7f44-4f6e-87bc-e8e03001395c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:24.091726 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-f4b86d5b-7f44-4f6e-87bc-e8e03001395c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034059 Nov 24 02:57:24.092368 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 12/23] 10.222.0.52 () {64 vars in 1332 bytes} [Wed Nov 24 02:57:24 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 02:57:26.547631 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-de38ac7e-f4e8-4180-86bb-0e1fc396aa0a admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:57:26.549299 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-de38ac7e-f4e8-4180-86bb-0e1fc396aa0a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002268 Nov 24 02:57:26.549751 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 12/24] 10.222.0.52 () {54 vars in 930 bytes} [Wed Nov 24 02:57:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:57:26.620967 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-82860a3c-4837-4626-9336-c479e49ba42c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "name": "m1.small", "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:26.641259 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-82860a3c-4837-4626-9336-c479e49ba42c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083339 Nov 24 02:57:26.641845 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 13/25] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Nov 24 02:57:26 2021] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 02:57:26.655839 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-c401d6ca-eef8-4e95-8b6d-cd571f2faf34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:26.681130 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-c401d6ca-eef8-4e95-8b6d-cd571f2faf34 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029208 Nov 24 02:57:26.681930 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 13/26] 10.222.0.52 () {64 vars in 1332 bytes} [Wed Nov 24 02:57:26 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 02:57:29.281455 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-82860a3c-4837-4626-9336-c479e49ba42c admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:57:29.283010 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-82860a3c-4837-4626-9336-c479e49ba42c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001790 Nov 24 02:57:29.284477 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 14/27] 10.222.0.52 () {54 vars in 930 bytes} [Wed Nov 24 02:57:29 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:57:29.367475 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-c675d17d-f25e-4e73-801c-280eb5dc8573 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "id": "3", "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium"}} {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:29.391301 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-c675d17d-f25e-4e73-801c-280eb5dc8573 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.097905 Nov 24 02:57:29.392028 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 14/28] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Nov 24 02:57:29 2021] POST /compute/v2.1/flavors => generated 406 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 02:57:29.411265 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-598bca26-024c-4f70-897a-182ddfa77c15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:29.439179 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-598bca26-024c-4f70-897a-182ddfa77c15 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032081 Nov 24 02:57:29.440279 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 15/29] 10.222.0.52 () {64 vars in 1332 bytes} [Wed Nov 24 02:57:29 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 02:57:31.907724 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-c675d17d-f25e-4e73-801c-280eb5dc8573 admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:57:31.908736 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-c675d17d-f25e-4e73-801c-280eb5dc8573 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Nov 24 02:57:31.909363 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 15/30] 10.222.0.52 () {54 vars in 930 bytes} [Wed Nov 24 02:57:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:57:31.973151 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-c28bc482-22ff-407d-b9d3-58008724bd66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "id": "4", "name": "m1.large", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:31.997005 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-c28bc482-22ff-407d-b9d3-58008724bd66 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080831 Nov 24 02:57:31.997590 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 16/31] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Nov 24 02:57:31 2021] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 02:57:32.010753 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-6c49aaa1-2cdc-4731-b465-5bdebd1e72fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:32.035289 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-6c49aaa1-2cdc-4731-b465-5bdebd1e72fe admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028313 Nov 24 02:57:32.035866 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 16/32] 10.222.0.52 () {64 vars in 1332 bytes} [Wed Nov 24 02:57:32 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 02:57:34.434235 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-c28bc482-22ff-407d-b9d3-58008724bd66 admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:57:34.435247 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-c28bc482-22ff-407d-b9d3-58008724bd66 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Nov 24 02:57:34.435825 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 17/33] 10.222.0.52 () {54 vars in 930 bytes} [Wed Nov 24 02:57:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:57:34.519204 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-ba4b6a82-c5fe-49be-a8a3-4dd5fe24ae34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "ram": 16384, "disk": 160, "os-flavor-access:is_public": true, "id": "5"}} {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:34.539316 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-ba4b6a82-c5fe-49be-a8a3-4dd5fe24ae34 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.093900 Nov 24 02:57:34.539883 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 17/34] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Nov 24 02:57:34 2021] POST /compute/v2.1/flavors => generated 408 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 02:57:34.552766 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-b21c57d0-097d-4a67-858a-dc60cf9cde0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:57:34.582887 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-b21c57d0-097d-4a67-858a-dc60cf9cde0e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033782 Nov 24 02:57:34.583668 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 18/35] 10.222.0.52 () {64 vars in 1332 bytes} [Wed Nov 24 02:57:34 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 02:58:00.661590 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-ba4b6a82-c5fe-49be-a8a3-4dd5fe24ae34 admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:00.662673 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-ba4b6a82-c5fe-49be-a8a3-4dd5fe24ae34 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Nov 24 02:58:00.663074 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 18/36] 10.222.0.52 () {54 vars in 930 bytes} [Wed Nov 24 02:58:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:58:00.724153 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-e5cfcf4c-499e-4ac4-8c34-9bd3f2a01e52 admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:00.741297 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-e5cfcf4c-499e-4ac4-8c34-9bd3f2a01e52 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071225 Nov 24 02:58:00.742288 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 19/37] 10.222.0.52 () {60 vars in 1291 bytes} [Wed Nov 24 02:58:00 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 02:58:02.255107 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-ba4b6a82-c5fe-49be-a8a3-4dd5fe24ae34 admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:02.256124 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-ba4b6a82-c5fe-49be-a8a3-4dd5fe24ae34 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Nov 24 02:58:02.256527 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 19/38] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Nov 24 02:58:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:58:02.451836 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-e28ec20b-c73d-460f-b8f7-247c3de4b74e admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:02.457453 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.wsgi [None req-e28ec20b-c73d-460f-b8f7-247c3de4b74e admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 24 02:58:02.458052 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-e28ec20b-c73d-460f-b8f7-247c3de4b74e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 02:58:02.458854 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-e28ec20b-c73d-460f-b8f7-247c3de4b74e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062131 Nov 24 02:58:02.459381 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 20/39] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Nov 24 02:58:02 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 02:58:02.469828 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-0a8825a7-7937-47bd-84fc-e8e289144a39 admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:02.490507 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-0a8825a7-7937-47bd-84fc-e8e289144a39 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024387 Nov 24 02:58:02.491067 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 20/40] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Nov 24 02:58:02 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 02:58:02.501874 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-f6266a23-0267-46cb-8068-5c252d24c1ac admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:02.523574 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-f6266a23-0267-46cb-8068-5c252d24c1ac admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025299 Nov 24 02:58:02.524128 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 21/41] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Nov 24 02:58:02 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 02:58:02.534756 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-3d023f00-42f0-4377-aad1-d73b4f772067 admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:02.541202 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.wsgi [None req-3d023f00-42f0-4377-aad1-d73b4f772067 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 24 02:58:02.541775 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-3d023f00-42f0-4377-aad1-d73b4f772067 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 02:58:02.542623 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-3d023f00-42f0-4377-aad1-d73b4f772067 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011657 Nov 24 02:58:02.543162 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 21/42] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Nov 24 02:58:02 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 02:58:03.947420 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-f6266a23-0267-46cb-8068-5c252d24c1ac admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:03.948468 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-f6266a23-0267-46cb-8068-5c252d24c1ac admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Nov 24 02:58:03.948862 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 22/43] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Nov 24 02:58:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:58:04.150494 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-230c78ad-0276-46c3-be1b-e4fb8183fffe admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:04.156468 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.wsgi [None req-230c78ad-0276-46c3-be1b-e4fb8183fffe admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 24 02:58:04.157020 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-230c78ad-0276-46c3-be1b-e4fb8183fffe admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 02:58:04.157825 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-230c78ad-0276-46c3-be1b-e4fb8183fffe admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063225 Nov 24 02:58:04.158376 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 22/44] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Nov 24 02:58:04 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 02:58:04.168474 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-c35c9693-c7e9-47f9-b692-b53fbd983bd3 admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:04.182438 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-c35c9693-c7e9-47f9-b692-b53fbd983bd3 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017578 Nov 24 02:58:04.183031 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 23/45] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Nov 24 02:58:04 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 02:58:04.193758 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-e86d2223-2484-4ab1-8ad9-a4d9b837deb0 admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:04.208602 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-e86d2223-2484-4ab1-8ad9-a4d9b837deb0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018330 Nov 24 02:58:04.209221 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 23/46] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Nov 24 02:58:04 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 02:58:04.225109 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-16f42fb9-e9f9-4777-880b-f89213fd763b admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:04.231792 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.wsgi [None req-16f42fb9-e9f9-4777-880b-f89213fd763b admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 24 02:58:04.232381 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-16f42fb9-e9f9-4777-880b-f89213fd763b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 02:58:04.233199 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-16f42fb9-e9f9-4777-880b-f89213fd763b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014275 Nov 24 02:58:04.233745 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 24/47] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Nov 24 02:58:04 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 02:58:05.623394 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-e86d2223-2484-4ab1-8ad9-a4d9b837deb0 admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:05.624407 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-e86d2223-2484-4ab1-8ad9-a4d9b837deb0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Nov 24 02:58:05.624815 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 24/48] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Nov 24 02:58:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:58:05.821257 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-76688a11-27de-490b-81aa-0a011604b10e admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:05.827739 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.wsgi [None req-76688a11-27de-490b-81aa-0a011604b10e admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 24 02:58:05.828218 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-76688a11-27de-490b-81aa-0a011604b10e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 02:58:05.829018 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-76688a11-27de-490b-81aa-0a011604b10e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062621 Nov 24 02:58:05.829533 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 25/49] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Nov 24 02:58:05 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 02:58:05.841500 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-fcb68c22-5d09-4d03-8fc5-5cec20cb7004 admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:05.855508 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-fcb68c22-5d09-4d03-8fc5-5cec20cb7004 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017592 Nov 24 02:58:05.856095 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 25/50] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Nov 24 02:58:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 02:58:05.867218 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-27953f73-bd77-4fd0-b639-ec35286571bd admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:05.881082 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-27953f73-bd77-4fd0-b639-ec35286571bd admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018148 Nov 24 02:58:05.881682 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 26/51] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Nov 24 02:58:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 02:58:05.895500 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-154ecf08-afff-4ecc-84f2-755e0c517b26 admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:05.901514 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.wsgi [None req-154ecf08-afff-4ecc-84f2-755e0c517b26 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 24 02:58:05.902120 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-154ecf08-afff-4ecc-84f2-755e0c517b26 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 02:58:05.902921 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-154ecf08-afff-4ecc-84f2-755e0c517b26 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014344 Nov 24 02:58:05.903451 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 26/52] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Nov 24 02:58:05 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 02:58:07.347926 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-27953f73-bd77-4fd0-b639-ec35286571bd admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:07.348950 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-27953f73-bd77-4fd0-b639-ec35286571bd admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Nov 24 02:58:07.349351 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 27/53] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Nov 24 02:58:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:58:07.545865 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-88c8d95a-7b54-4b75-a1e7-97c45f5e2ee0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:58:07.566801 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-88c8d95a-7b54-4b75-a1e7-97c45f5e2ee0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.077317 Nov 24 02:58:07.567344 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 27/54] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Nov 24 02:58:07 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 02:58:08.975046 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-27953f73-bd77-4fd0-b639-ec35286571bd admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:08.976057 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-27953f73-bd77-4fd0-b639-ec35286571bd admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Nov 24 02:58:08.976454 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 28/55] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Nov 24 02:58:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:58:09.174631 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-212fcd42-c63a-4553-8c8f-125021c5c31f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:58:09.194216 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-212fcd42-c63a-4553-8c8f-125021c5c31f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.078697 Nov 24 02:58:09.194804 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 28/56] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Nov 24 02:58:09 2021] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 02:58:10.587990 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-27953f73-bd77-4fd0-b639-ec35286571bd admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:10.589004 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-27953f73-bd77-4fd0-b639-ec35286571bd admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Nov 24 02:58:10.589407 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 29/57] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Nov 24 02:58:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:58:10.789298 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-164cb7dc-7eaf-4c72-a129-9469829a30ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:58:10.808962 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-164cb7dc-7eaf-4c72-a129-9469829a30ab admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.073697 Nov 24 02:58:10.809427 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 29/58] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Nov 24 02:58:10 2021] POST /compute/v2.1/flavors => generated 407 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 02:58:12.199694 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-27953f73-bd77-4fd0-b639-ec35286571bd admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:12.200705 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-27953f73-bd77-4fd0-b639-ec35286571bd admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Nov 24 02:58:12.201101 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 30/59] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Nov 24 02:58:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:58:12.400005 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-f642367c-4cd5-45a6-aaf2-833fb7225de4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 02:58:12.421066 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-f642367c-4cd5-45a6-aaf2-833fb7225de4 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.075927 Nov 24 02:58:12.421527 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 30/60] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Nov 24 02:58:12 2021] POST /compute/v2.1/flavors => generated 409 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 02:58:13.800717 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-27953f73-bd77-4fd0-b639-ec35286571bd admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:13.801775 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-27953f73-bd77-4fd0-b639-ec35286571bd admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Nov 24 02:58:13.802196 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 31/61] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Nov 24 02:58:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:58:14.021417 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-03b53d60-065d-48e3-a0fd-04c369f525a9 admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:58:14.042319 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-03b53d60-065d-48e3-a0fd-04c369f525a9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.079510 Nov 24 02:58:14.042938 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 31/62] 10.222.0.52 () {60 vars in 1202 bytes} [Wed Nov 24 02:58:13 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 02:59:01.050920 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-27953f73-bd77-4fd0-b639-ec35286571bd admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:59:01.051937 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-27953f73-bd77-4fd0-b639-ec35286571bd admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Nov 24 02:59:01.052315 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 32/63] 10.222.0.52 () {54 vars in 930 bytes} [Wed Nov 24 02:59:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 02:59:01.114689 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-a32b9e4d-f787-4280-bf87-9df943baa41f admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:59:01.137432 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-a32b9e4d-f787-4280-bf87-9df943baa41f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078222 Nov 24 02:59:01.138011 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 32/64] 10.222.0.52 () {60 vars in 1291 bytes} [Wed Nov 24 02:59:01 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 02:59:01.160441 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-5d1d9af5-574a-4bf4-af01-bb84d77f41d3 admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:59:01.168462 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-5d1d9af5-574a-4bf4-af01-bb84d77f41d3 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011650 Nov 24 02:59:01.168986 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 33/65] 10.222.0.52 () {60 vars in 1282 bytes} [Wed Nov 24 02:59:01 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 02:59:01.181663 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-1740eb34-a99c-4d2b-ab64-8178c5f19517 admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:59:01.189964 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-1740eb34-a99c-4d2b-ab64-8178c5f19517 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012498 Nov 24 02:59:01.190561 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 33/66] 10.222.0.52 () {60 vars in 1285 bytes} [Wed Nov 24 02:59:01 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 02:59:01.204194 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-b5410402-420b-41c6-8eb4-4fb1c4da31c8 admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:59:01.212941 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-b5410402-420b-41c6-8eb4-4fb1c4da31c8 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012626 Nov 24 02:59:01.213486 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 34/67] 10.222.0.52 () {60 vars in 1285 bytes} [Wed Nov 24 02:59:01 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 02:59:01.226563 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-0d5812cf-a55c-4198-962f-90f7c8574a0e admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 02:59:01.234207 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-0d5812cf-a55c-4198-962f-90f7c8574a0e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011735 Nov 24 02:59:01.234674 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 34/68] 10.222.0.52 () {60 vars in 1282 bytes} [Wed Nov 24 02:59:01 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:00:26.928385 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-2091c7a3-5559-40e3-9208-ec215c4f90ad tempest-verify_tempest_config-203383476 tempest-verify_tempest_config-203383476-project] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:00:26.930375 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-2091c7a3-5559-40e3-9208-ec215c4f90ad tempest-verify_tempest_config-203383476 tempest-verify_tempest_config-203383476-project] 10.222.0.52 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.121881 Nov 24 03:00:26.930892 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 35/69] 10.222.0.52 () {58 vars in 1133 bytes} [Wed Nov 24 03:00:26 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:01:52.513176 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-0d5812cf-a55c-4198-962f-90f7c8574a0e admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:01:52.514296 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-0d5812cf-a55c-4198-962f-90f7c8574a0e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001636 Nov 24 03:01:52.514696 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 35/70] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Nov 24 03:01:52 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:01:52.785413 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-a8b4b7ac-f49f-4466-833a-cb9497d78b7a admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:01:52.786593 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:01:52.786593 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: warnings.warn(msg) Nov 24 03:01:52.788111 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-a8b4b7ac-f49f-4466-833a-cb9497d78b7a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:01:52.788641 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-a8b4b7ac-f49f-4466-833a-cb9497d78b7a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:01:52.789452 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-a8b4b7ac-f49f-4466-833a-cb9497d78b7a admin admin] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:01:52.789859 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-a8b4b7ac-f49f-4466-833a-cb9497d78b7a admin admin] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:01:52.823700 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-a8b4b7ac-f49f-4466-833a-cb9497d78b7a admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.168152 Nov 24 03:01:52.824269 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 36/71] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Nov 24 03:01:52 2021] GET /compute/v2.1/os-services => generated 791 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:01:54.253765 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-0d5812cf-a55c-4198-962f-90f7c8574a0e admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:01:54.254813 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-0d5812cf-a55c-4198-962f-90f7c8574a0e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Nov 24 03:01:54.255205 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 36/72] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Nov 24 03:01:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:01:54.457453 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-89514b92-4066-4c38-992a-a6e35b378ce5 admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:01:54.458627 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:01:54.458627 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: warnings.warn(msg) Nov 24 03:01:54.460146 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-89514b92-4066-4c38-992a-a6e35b378ce5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:01:54.460851 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-89514b92-4066-4c38-992a-a6e35b378ce5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:01:54.462045 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-89514b92-4066-4c38-992a-a6e35b378ce5 admin admin] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:01:54.462471 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-89514b92-4066-4c38-992a-a6e35b378ce5 admin admin] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:01:54.487080 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-89514b92-4066-4c38-992a-a6e35b378ce5 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.090400 Nov 24 03:01:54.487632 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 37/73] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Nov 24 03:01:54 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:02:06.347514 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-0d5812cf-a55c-4198-962f-90f7c8574a0e admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:02:06.348588 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-0d5812cf-a55c-4198-962f-90f7c8574a0e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Nov 24 03:02:06.349024 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 37/74] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Nov 24 03:02:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:02:06.550682 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-1542bfb8-decf-4a7c-9da6-dcf7b45f9317 admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:02:06.551864 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:02:06.551864 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: warnings.warn(msg) Nov 24 03:02:06.553382 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-1542bfb8-decf-4a7c-9da6-dcf7b45f9317 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:02:06.553812 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-1542bfb8-decf-4a7c-9da6-dcf7b45f9317 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:02:06.554619 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-1542bfb8-decf-4a7c-9da6-dcf7b45f9317 admin admin] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:02:06.555033 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-1542bfb8-decf-4a7c-9da6-dcf7b45f9317 admin admin] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:02:06.576430 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-1542bfb8-decf-4a7c-9da6-dcf7b45f9317 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084826 Nov 24 03:02:06.576983 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 38/75] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Nov 24 03:02:06 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:02:08.051018 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: DEBUG nova.api.openstack.wsgi [None req-0d5812cf-a55c-4198-962f-90f7c8574a0e admin admin] Calling method '>' {{(pid=102107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:02:08.052170 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: INFO nova.api.openstack.requestlog [None req-0d5812cf-a55c-4198-962f-90f7c8574a0e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001883 Nov 24 03:02:08.052570 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: [pid: 102107|app: 0|req: 38/76] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Nov 24 03:02:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:02:08.255269 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG nova.api.openstack.wsgi [None req-ba444526-ca53-442a-a47b-0c9f068ee1de admin admin] Calling method '>' {{(pid=102106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:02:08.256761 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:02:08.256761 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: warnings.warn(msg) Nov 24 03:02:08.259084 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-ba444526-ca53-442a-a47b-0c9f068ee1de admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:02:08.259721 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-ba444526-ca53-442a-a47b-0c9f068ee1de admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:02:08.260866 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-ba444526-ca53-442a-a47b-0c9f068ee1de admin admin] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:02:08.261298 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: DEBUG oslo_concurrency.lockutils [None req-ba444526-ca53-442a-a47b-0c9f068ee1de admin admin] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:02:08.283604 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: INFO nova.api.openstack.requestlog [None req-ba444526-ca53-442a-a47b-0c9f068ee1de admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089446 Nov 24 03:02:08.284160 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: [pid: 102106|app: 0|req: 39/77] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Nov 24 03:02:08 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:03:03.483993 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: Wed Nov 24 03:03:03 2021 - graceful shutdown triggered... Nov 24 03:03:03.484090 dv-cinder-818037-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 24 03:03:03.485127 dv-cinder-818037-6-iscsi devstack@n-api.service[102106]: Gracefully killing worker 1 (pid: 102106)... Nov 24 03:03:03.485532 dv-cinder-818037-6-iscsi devstack@n-api.service[102107]: Gracefully killing worker 2 (pid: 102107)... Nov 24 03:03:04.486191 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: worker 1 buried after 1 seconds Nov 24 03:03:04.486191 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: worker 2 buried after 1 seconds Nov 24 03:03:04.486191 dv-cinder-818037-6-iscsi devstack@n-api.service[102105]: goodbye to uWSGI. Nov 24 03:03:04.487890 dv-cinder-818037-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 24 03:03:04.488538 dv-cinder-818037-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 24 03:03:04.492367 dv-cinder-818037-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 24 03:03:04.502226 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 24 03:03:04.504371 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 24 03:03:04 2021] *** Nov 24 03:03:04.504371 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 24 03:03:04.504371 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 24 03:03:04.504371 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: nodename: dv-cinder-818037-6-iscsi Nov 24 03:03:04.504371 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: machine: x86_64 Nov 24 03:03:04.504371 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: clock source: unix Nov 24 03:03:04.504371 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: pcre jit disabled Nov 24 03:03:04.504371 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: detected number of CPU cores: 4 Nov 24 03:03:04.504371 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: current working directory: / Nov 24 03:03:04.504371 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: detected binary path: /usr/bin/uwsgi-core Nov 24 03:03:04.504371 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: your processes number limit is 47680 Nov 24 03:03:04.504371 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: your memory page size is 4096 bytes Nov 24 03:03:04.504371 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: detected max file descriptor number: 2048 Nov 24 03:03:04.504371 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: lock engine: pthread robust mutexes Nov 24 03:03:04.505405 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: thunder lock: enabled Nov 24 03:03:04.505405 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 24 03:03:04.505405 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 24 03:03:04.549611 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: Python main interpreter initialized at 0x558a6f0149c0 Nov 24 03:03:04.549611 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: python threads support enabled Nov 24 03:03:04.549611 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: your server socket listen backlog is limited to 100 connections Nov 24 03:03:04.549611 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: your mercy for graceful operations on workers is 90 seconds Nov 24 03:03:04.550103 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: mapped 403077 bytes (393 KB) for 2 cores Nov 24 03:03:04.550103 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: *** Operational MODE: preforking *** Nov 24 03:03:04.550398 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: *** uWSGI is running in multiple interpreter mode *** Nov 24 03:03:04.550398 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: spawned uWSGI master process (pid: 116313) Nov 24 03:03:04.550621 dv-cinder-818037-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 24 03:03:04.553182 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: spawned uWSGI worker 1 (pid: 116330, cores: 1) Nov 24 03:03:04.553182 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: spawned uWSGI worker 2 (pid: 116331, cores: 1) Nov 24 03:03:04.553182 dv-cinder-818037-6-iscsi devstack@n-api.service[116313]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 24 03:03:06.296693 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 03:03:06.296693 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: from cryptography.utils import int_from_bytes Nov 24 03:03:06.297404 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 03:03:06.297404 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: from cryptography.utils import int_from_bytes Nov 24 03:03:06.297979 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 03:03:06.297979 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: from cryptography.utils import int_from_bytes Nov 24 03:03:06.298534 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 03:03:06.298534 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: from cryptography.utils import int_from_bytes Nov 24 03:03:08.627799 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 03:03:08.628425 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 03:03:08.628509 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 03:03:08.628893 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 03:03:08.629177 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 03:03:08.629570 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.629897 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.630269 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.630589 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.630916 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.631225 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.631545 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.631863 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.632187 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.632427 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.632761 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.633057 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-6-iscsi {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.633375 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.633723 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.634058 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.634374 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.634663 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.634987 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.635279 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.635790 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.637164 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.637164 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.637164 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.637433 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.637755 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.638144 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.638469 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.638735 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.639063 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.639391 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.639808 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-6-iscsi {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.640112 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.640417 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.640733 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.641150 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.641476 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.641774 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.642223 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.642524 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.642833 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.643172 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.643478 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.643798 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.644135 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.644836 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.645132 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.645464 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.645761 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.646093 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.646406 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.646656 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.646959 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.647277 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.647600 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.647925 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.648153 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.648413 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.648728 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.649850 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.649850 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.650177 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 03:03:08.650700 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.650848 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 03:03:08.650998 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.650998 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.651313 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 03:03:08.651467 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.651619 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 03:03:08.651761 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.651909 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 03:03:08.652063 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.652214 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.652370 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.652519 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.652660 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.652807 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.653010 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.653168 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.653333 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.653489 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.653642 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.653828 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.654631 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.654788 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.654941 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.655084 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.655233 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.655385 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.655560 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.655716 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.655872 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.656034 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.656205 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.656424 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-6-iscsi {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.656700 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.656878 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.657022 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.657171 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.657319 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.657469 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.657729 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.658003 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.658168 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.658319 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.658485 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.658635 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.658787 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.658940 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.659091 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.659091 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.659376 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.659549 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.659701 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.659842 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.659982 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.660133 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.660336 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.660572 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.660988 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.661134 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.661288 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.661439 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.661592 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.661739 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.661895 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.662307 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.662471 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.662623 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.662793 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.662940 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.663031 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.663164 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.663164 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.663374 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-6-iscsi {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.663562 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.663736 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.663823 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.663913 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.664002 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.664112 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.664244 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.664344 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.664445 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.664528 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.665057 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.665172 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.665259 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.665341 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.665430 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.665524 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.665612 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.665708 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.665800 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.665883 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.666038 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.666130 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.666222 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.666312 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.666403 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.666403 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.666575 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.666575 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.666756 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.666840 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.666929 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.667012 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.667102 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.667102 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.667261 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.667261 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.667419 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.667511 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.667600 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.667686 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.667768 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.667849 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.667938 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.668030 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.668121 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.668210 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.668299 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.668383 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.668473 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.668565 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.668648 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.668738 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.668826 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.668920 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.669012 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.669096 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.669184 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.669420 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.669557 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.669730 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.669844 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.670072 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.670186 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.670369 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.670468 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.670673 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.670775 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.670990 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.671087 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.671290 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.671378 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.671608 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.671718 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.671897 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.671988 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.672212 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.672311 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.672535 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.672625 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.672844 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.672943 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.673164 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.673255 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.673494 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.673583 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.673798 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.673886 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.674131 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.674224 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.674477 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.674604 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.674786 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.674908 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.675092 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.675197 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.675413 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.675517 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.675719 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.675911 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.676086 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.676188 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.676395 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.676493 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.676714 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.676812 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.677035 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.677139 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.677368 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.677466 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.677685 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.677783 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.677993 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.678104 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.678299 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.678397 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.678605 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.678696 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.678925 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.679017 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.679232 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.679321 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.679543 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.679702 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.679862 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.680000 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.680141 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.680273 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.680419 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.680557 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.680715 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.680856 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.681013 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.681165 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.681309 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.681452 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.681604 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.681741 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.681886 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.682044 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.682262 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.682424 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.682577 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.682714 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.682850 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.682993 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.683148 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.683300 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.683444 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.683581 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.683716 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.683913 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.684063 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.684235 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.684384 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.684556 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.684697 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.684864 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.685228 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.685392 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.685537 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.685684 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.685833 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.686040 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.686127 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.686209 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.686287 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.686363 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.686447 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.686684 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.686783 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.687053 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.687146 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.687305 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.687404 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.687652 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.687787 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.687954 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.688097 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.688261 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.688400 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.688569 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.688692 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.688866 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.688989 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.689172 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.689316 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.689470 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.689613 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.689797 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.689899 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.690158 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.690239 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.690460 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.690556 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.690719 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.690855 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.691035 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.691159 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.691322 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.691469 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.691647 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.691773 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.691941 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.692103 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.692254 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.692416 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.692567 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.692758 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.692891 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.693035 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.693305 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.693425 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 03:03:08.693514 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.693684 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.693844 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.694048 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.694225 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.694396 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.694548 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.694716 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.694875 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.695063 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.695335 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.695439 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.695526 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.695690 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.695814 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.695991 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.696182 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.696313 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.696415 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.696647 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.696746 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.696961 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.697060 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.697315 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.697421 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.697637 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.697752 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.697960 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.698056 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.698246 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.698380 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.698555 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.698656 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.698875 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.698975 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.699201 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.699308 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.699517 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.699642 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.699830 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.699923 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.700132 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.700216 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.700439 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.700549 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.700777 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.700889 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.701085 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.701190 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.701427 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.701533 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.701765 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.701872 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.702115 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.702216 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.702442 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.702540 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.702756 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.702844 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.703073 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.703170 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.703376 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.703472 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.703694 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.703803 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.704004 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.704095 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.704317 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.704408 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.704639 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.704739 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.704951 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.705056 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.705272 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.705392 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.705589 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.705706 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.706073 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.706196 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.706287 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.706394 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.706533 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.706642 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.706838 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.706930 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.707204 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.707294 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.707515 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.707617 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.707898 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.707996 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.708216 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.708317 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.708541 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.708634 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.708854 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.708946 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.709170 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.709280 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.709481 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.709661 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.709793 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.709885 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.710129 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.710222 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.710445 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.710625 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.710778 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.710925 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.711063 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.711208 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.711426 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.711561 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.711701 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.711837 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.711970 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.712115 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.712252 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.712383 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.712553 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.712686 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.712859 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.713006 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.713171 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.713318 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.713489 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.713627 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.713855 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.714034 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.714138 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.714222 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.714437 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.714540 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.714752 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.714851 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.715074 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.715180 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.715374 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.715470 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.715688 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.715790 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.715996 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.716103 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.716304 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.716389 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.716619 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.716710 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.716935 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.717032 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.717247 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.717343 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.717554 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.717643 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.717860 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.718008 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.718196 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.718287 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.718504 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.718608 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.718809 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.718906 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.719113 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.719211 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.719418 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.719506 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.719725 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.719821 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.720031 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.720133 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.720338 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.720428 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.720660 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.720748 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.720966 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.721066 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.721272 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.721362 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.721576 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.721671 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.721884 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.722006 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.722220 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.722310 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.722545 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.722667 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.722895 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.722985 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.723860 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.723967 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.724040 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.724118 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.724267 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.724348 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.724425 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.724501 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.724577 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.724645 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.724762 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.724845 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.725092 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.725184 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.725464 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.725556 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.725766 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.725866 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.726038 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.726181 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.726425 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.726526 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.726655 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.726803 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.727944 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.728052 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.728135 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.728230 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.728313 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.728394 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.728539 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.728625 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.728713 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.728805 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.728893 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.728983 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.729071 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.729227 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.729317 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.729413 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.729495 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.729576 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.729801 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.729901 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.730842 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.730989 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.731069 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.731139 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.731216 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.731216 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.731356 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.731433 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.731515 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.731718 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.731818 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.732037 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.732137 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.732348 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.732445 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.732667 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.732764 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.732980 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.733079 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.733303 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.733393 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.733610 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.733707 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.733942 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.734049 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.734248 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.734339 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.734553 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.734651 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.734864 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.734954 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.735172 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.735310 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.735480 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.735581 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.735785 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.735884 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.736093 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.736202 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.736398 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.736506 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.736701 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.736851 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.737019 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.737306 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.737447 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.737597 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.737749 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.737941 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.738076 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.738223 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.738410 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.738564 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.738709 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.738849 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.738985 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.739188 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.739188 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.739459 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.739624 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.739771 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.739908 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.740054 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.740190 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.740327 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.740463 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.740599 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.740747 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.740857 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.741038 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.741175 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.741320 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.741467 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.741613 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.741750 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.741893 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.742031 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.742217 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.742311 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.742525 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.742624 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.742851 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.742950 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.743165 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.743255 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.743472 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.743567 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.743777 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.743859 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.744087 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.744236 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.744378 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.744530 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.744675 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.744817 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.744974 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.745078 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.745285 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.745377 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.745596 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.745692 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.745898 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.746040 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.746229 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.746334 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.746534 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.746636 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.746849 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.746962 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.747153 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.747274 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.747458 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.747570 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.747755 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.747849 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.748067 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.748160 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.748374 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.748463 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.748677 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.748777 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.748987 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.749086 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.749285 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.749383 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.749601 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.749700 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.749905 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.750027 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.750235 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.750326 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.750537 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.750636 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.750846 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.750942 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.751157 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.751259 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.751461 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.751741 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.751833 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.752077 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.752168 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.752379 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.752471 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.752683 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.752774 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.752994 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.753093 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.753298 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.753398 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.753604 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.753705 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.754107 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.754222 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.754318 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.754438 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.754604 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.754759 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.754916 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.755067 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.755221 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.755380 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.755615 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.755700 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.755857 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.755996 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.756172 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.756302 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.756427 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.756611 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.756732 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.756914 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.757052 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.757281 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.757374 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.757568 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.757671 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.757832 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.758003 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.758164 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.758315 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.758487 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.758631 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.758798 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.758937 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.759102 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.759249 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.759409 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.759553 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.759712 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.759877 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.760055 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.760189 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.760359 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.760495 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.760718 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.760806 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.761022 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.761113 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.761466 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.761573 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.761647 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.761724 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.762996 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.763123 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.763221 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.763307 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.763391 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.763471 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.763605 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.763695 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.763768 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.763849 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.763930 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.764013 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.764109 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.764193 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.764282 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.764383 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.764467 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.764579 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.764881 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.764986 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.765068 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.765149 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.765343 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.765441 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.765663 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.765793 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.766069 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.766177 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.766334 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.766507 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.766644 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.766742 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.766954 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.767046 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.767265 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.767378 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.767573 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.767697 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.767882 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.767981 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.768188 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.768357 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.768493 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.768597 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.768795 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.768880 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.769109 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.769630 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.769806 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.770033 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.770323 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.770434 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.770537 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.770623 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.770769 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.770863 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.771083 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.771183 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.771390 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.771482 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.771739 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.771848 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.772026 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.772126 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.772331 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.772450 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.772713 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.772825 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.772919 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.773062 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.773248 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.773340 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.773563 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.773664 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.773903 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.774035 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.774199 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.774390 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.774511 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.774739 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.774831 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.775080 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.775175 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.775303 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.775396 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.775657 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.775744 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.775979 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.776238 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.776328 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.776406 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.776601 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.776707 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.776911 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.777036 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.777285 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.777376 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.777506 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.777610 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.777852 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.778009 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.778132 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.778253 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.778445 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.778657 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.778771 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.778932 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.779079 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.779233 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.779371 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.779522 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.779665 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.779797 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.779938 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.780093 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.780242 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.780389 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.780542 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.780695 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.780854 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.781021 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.781219 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.781369 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.781533 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.781702 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.781863 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.782068 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.782262 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.782419 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.782581 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.782744 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.782935 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.783083 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.783254 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.783432 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.783584 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.783763 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.784026 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.784026 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.784307 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.784307 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.784611 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.784748 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.784902 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.785047 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.785240 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.785240 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.785508 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.785619 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.785786 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.785947 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.786061 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.786174 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.786318 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.786450 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.786559 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.786698 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.786857 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.787006 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.787180 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.787297 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.787497 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.787609 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.787821 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.787929 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.788175 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.788276 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.788482 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.788581 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.788793 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.788972 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.789104 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.789194 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.789415 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.789507 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.789726 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.789818 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.790072 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.790180 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.790386 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.790477 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.790692 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.790790 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.790999 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.791096 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.791312 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.791402 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.791616 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.791709 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.791919 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.792021 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.792230 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.792319 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.792575 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.792687 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.792842 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.792960 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.793148 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.793316 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.793476 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.793639 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.793784 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.793998 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.794181 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.794282 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.794401 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.794502 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.794726 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.794820 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.795049 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.795143 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.795356 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.795448 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.795680 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.795817 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.795990 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.796093 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.796308 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.796405 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.796646 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.796754 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.796912 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.796995 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.797261 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.797580 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.797951 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.798213 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.798320 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.798475 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.798577 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.798905 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.799019 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.799108 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.799211 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.799402 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.799538 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.799709 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.799856 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.800013 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.800289 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.800394 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.800498 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.800712 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.800861 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.801265 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.801582 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.801983 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.802081 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.802221 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.802386 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.802528 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.802734 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.802838 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.803419 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.803539 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.803627 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.803715 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.803715 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.803875 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.804036 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.804220 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.804373 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.804518 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.804667 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.804819 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.804967 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.805134 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.805278 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.805452 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.805608 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.805783 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.805947 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.806138 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.806244 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.806469 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.806572 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.806784 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.806884 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.807105 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.807205 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.807424 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.807549 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.807750 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.807849 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.808067 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.808176 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.808380 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.808524 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.808697 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.808836 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.808989 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.809134 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.809314 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.809453 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.809633 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.809780 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.809979 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.810084 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.810281 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.810387 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.810598 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.810701 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.810907 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.811007 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.811223 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.811321 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.811537 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.811637 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.811856 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.811960 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.812235 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.812427 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.812546 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.812758 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.812848 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.813074 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.813170 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.813387 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.813494 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.813703 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.813814 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.814043 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.814150 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.814364 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.814478 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.814678 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.814788 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.814987 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.815079 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.815296 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.815396 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.815604 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.815707 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.815928 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.816019 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.816244 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.816444 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.816609 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.816719 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.817060 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.817175 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.817301 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.817393 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.817619 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.817733 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.818095 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.818196 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.818281 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.818395 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.818609 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.818715 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.818924 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.819017 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.819230 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.819321 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.819539 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.819622 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.819851 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.819940 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.820166 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.820263 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.820478 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.820586 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.820792 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.820892 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.821145 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.821252 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.821419 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.821521 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.821747 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.821840 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.822082 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.822192 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.822944 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.823056 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.823132 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.823224 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.823296 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.823377 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.823450 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.823738 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.823738 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.823957 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.824255 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.824471 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.824569 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.824794 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.824885 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.825116 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.825208 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.825429 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.825510 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.825735 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.826051 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.826172 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.826328 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.826526 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.826651 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.826847 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.826964 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.827176 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.827333 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.827492 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.827584 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.827804 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.827990 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.828156 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.828400 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.828652 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.828802 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.828947 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.829032 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.829116 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.829303 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.829444 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.829591 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.829740 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.829886 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.830014 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.830104 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.830321 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.830425 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.830636 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.830743 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.830967 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.831059 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.831288 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.831368 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.831607 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.831876 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.831984 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.832271 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.832356 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.832589 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.832678 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.832907 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.833015 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.833225 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.833365 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.833540 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.833685 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.833859 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.834107 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.834217 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.834423 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.834513 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.834735 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.835045 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.835126 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.835364 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.835453 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.835680 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.835775 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.836612 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.836794 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.836889 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.836970 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.837049 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.837151 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.837444 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.837524 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.837602 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.837686 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.837778 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.837867 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.837979 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.838061 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.838152 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.838233 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.838503 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.838604 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.838701 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.838774 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.838994 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.839106 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.839302 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.839397 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.839606 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.839698 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.839911 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.840018 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.840216 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.840307 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.840517 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.840617 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.840829 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.840929 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.841134 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.841236 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.841439 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.841547 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.841741 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.841852 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.842073 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.842178 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.842377 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.842467 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.842682 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.842773 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.842987 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.843068 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.843310 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.843400 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.843617 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.843700 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.843918 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.844000 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.844253 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.844348 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.844543 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.844627 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.844864 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.844945 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.845178 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.845258 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.845488 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.845569 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.845815 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.845893 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.846242 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.846396 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.846531 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.846718 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.846863 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.847109 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.847272 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.847537 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.847684 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.847909 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.848211 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.848355 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.848649 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.848773 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.848863 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.848940 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.849142 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.849245 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.849464 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.849561 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.849776 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.849865 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.850106 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.850194 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.850412 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.850494 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.850721 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.850814 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.851031 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.851120 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.851368 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.851468 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.851642 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.851734 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.851952 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.852040 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.852258 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.852344 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.852569 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.852651 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.852877 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.852956 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.853215 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.853423 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.853534 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.853776 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.853856 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.854409 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.854575 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.854720 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.854861 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.855014 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.855155 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.855305 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.855445 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.855587 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.855735 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.855883 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.856024 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.856184 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.856325 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.856476 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.856625 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.856775 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.856927 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.857069 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.857209 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.857349 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.857496 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.857822 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.858073 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.858224 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.858384 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.858527 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.858834 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.858993 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.859236 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.859461 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.859608 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.859758 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.859907 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.860058 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.860206 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.860356 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.860516 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.860664 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.860819 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.860971 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.861111 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.861259 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.861259 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.861613 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.861760 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.861930 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.862080 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.862238 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.862388 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.862553 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.862713 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.862864 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.862864 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.863142 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.863336 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.863799 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.864001 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.864166 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.864310 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.864451 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.864451 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.864845 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.865016 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.865161 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.865310 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.865450 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.865589 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.865730 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.865891 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.866804 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.866962 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.867116 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.867265 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.867416 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.867579 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.867748 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.868060 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.868214 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.868365 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.868520 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.868670 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.868981 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.869143 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.869286 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.869444 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.869685 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.869685 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.870003 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.870149 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.870292 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.870431 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.870584 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.870731 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.870873 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.871028 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.871170 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.871319 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.871475 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.871634 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.871865 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.872018 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.872161 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.872322 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.872475 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.872626 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.872768 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.872957 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.873112 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.873273 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.873424 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.873566 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.873707 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.873859 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.874043 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.874202 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.874360 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.874502 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.874642 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.874783 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.875051 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.875209 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.875358 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.875501 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.875649 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.875810 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.875966 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.876116 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.876263 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.876403 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.876552 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.876692 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.876841 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.876988 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.877129 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.877268 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.877415 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.877564 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.877717 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.878069 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.878247 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.878391 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.878535 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.878691 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 03:03:08.878842 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.878842 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.878842 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.878842 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.878842 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.878842 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.878842 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.880220 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.880220 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.880220 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.880220 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.880758 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.880758 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.881038 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.881190 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.881503 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.881938 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.882223 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.882591 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.882904 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.883210 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.883522 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.883856 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.884224 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.884506 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.884827 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.885138 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.886010 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.886010 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.886358 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.886547 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.886708 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.887019 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.887358 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.887669 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.887985 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.888325 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.888593 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.888972 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.889371 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.889627 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.890185 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.890494 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.890823 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.891144 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.891467 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.891786 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.892102 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.892432 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.893278 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.893278 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.893588 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.893736 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.894005 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.894719 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.895050 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.895381 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.895755 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.896165 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.896386 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.896668 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.897032 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.897350 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.897679 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.898003 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.898420 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 03:03:08.898638 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 03:03:08.901322 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_db.sqlalchemy.engines [None req-335900c6-a84f-43e4-b468-eb0d98e6a87a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 03:03:08.921620 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_db.sqlalchemy.engines [None req-ca11aa0a-e332-4616-ad27-b80da9ba80dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 03:03:09.063600 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.context [None req-335900c6-a84f-43e4-b468-eb0d98e6a87a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7bf0cf92-00d1-4d68-9678-23382842fbe7(cell1) {{(pid=116330) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 03:03:09.068146 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-335900c6-a84f-43e4-b468-eb0d98e6a87a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:09.069722 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-335900c6-a84f-43e4-b468-eb0d98e6a87a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:09.070594 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-335900c6-a84f-43e4-b468-eb0d98e6a87a None None] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:09.072545 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-335900c6-a84f-43e4-b468-eb0d98e6a87a None None] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:09.084111 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_db.sqlalchemy.engines [None req-335900c6-a84f-43e4-b468-eb0d98e6a87a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 03:03:09.084878 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_db.sqlalchemy.engines [None req-335900c6-a84f-43e4-b468-eb0d98e6a87a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 03:03:09.091803 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.context [None req-ca11aa0a-e332-4616-ad27-b80da9ba80dd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7bf0cf92-00d1-4d68-9678-23382842fbe7(cell1) {{(pid=116331) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 03:03:09.096456 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ca11aa0a-e332-4616-ad27-b80da9ba80dd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:09.098149 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ca11aa0a-e332-4616-ad27-b80da9ba80dd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:09.099036 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ca11aa0a-e332-4616-ad27-b80da9ba80dd None None] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:09.100966 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ca11aa0a-e332-4616-ad27-b80da9ba80dd None None] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:09.113234 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_db.sqlalchemy.engines [None req-ca11aa0a-e332-4616-ad27-b80da9ba80dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 03:03:09.114727 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_db.sqlalchemy.engines [None req-ca11aa0a-e332-4616-ad27-b80da9ba80dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 03:03:09.256750 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_db.sqlalchemy.engines [None req-335900c6-a84f-43e4-b468-eb0d98e6a87a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 03:03:09.280511 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_db.sqlalchemy.engines [None req-ca11aa0a-e332-4616-ad27-b80da9ba80dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 03:03:09.572811 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: WARNING keystonemiddleware.auth_token [None req-335900c6-a84f-43e4-b468-eb0d98e6a87a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 03:03:09.579270 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: WARNING keystonemiddleware.auth_token [None req-335900c6-a84f-43e4-b468-eb0d98e6a87a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 03:03:09.596242 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: WARNING keystonemiddleware.auth_token [None req-ca11aa0a-e332-4616-ad27-b80da9ba80dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 03:03:09.602851 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: WARNING keystonemiddleware.auth_token [None req-ca11aa0a-e332-4616-ad27-b80da9ba80dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 03:03:09.924369 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: WARNING keystonemiddleware.auth_token [None req-335900c6-a84f-43e4-b468-eb0d98e6a87a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 03:03:09.929887 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: WARNING keystonemiddleware.auth_token [None req-335900c6-a84f-43e4-b468-eb0d98e6a87a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 03:03:09.935387 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558a6f0149c0 pid: 116330 (default app) Nov 24 03:03:09.949670 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: WARNING keystonemiddleware.auth_token [None req-ca11aa0a-e332-4616-ad27-b80da9ba80dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 03:03:09.955083 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: WARNING keystonemiddleware.auth_token [None req-ca11aa0a-e332-4616-ad27-b80da9ba80dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 03:03:09.960694 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558a6f0149c0 pid: 116331 (default app) Nov 24 03:03:45.294706 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6c3dfdd5-d207-46c7-b6f3-f93558864d3d tempest-VolumesGetTestJSON-708372623 tempest-VolumesGetTestJSON-708372623-project] Action: 'create', calling method: .version_select at 0x7f7a2fe11550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-45359358", "metadata": {"Type": "work"}}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:03:45.802018 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-d8df8bd1-5eeb-470c-bb1e-f1657d1444e1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-336920426", "imageRef": "04860a4a-47c3-4532-865d-be6c9c493af7", "flavorRef": "452", "networks": [{"uuid": "3f10594b-6f86-48fa-a7b0-505b247d8265"}]}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:03:46.406584 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.network.neutron [None req-d8df8bd1-5eeb-470c-bb1e-f1657d1444e1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] validate_networks() for [('3f10594b-6f86-48fa-a7b0-505b247d8265', None, None, None, None, None)] {{(pid=116331) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:03:47.047381 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6c3dfdd5-d207-46c7-b6f3-f93558864d3d tempest-VolumesGetTestJSON-708372623 tempest-VolumesGetTestJSON-708372623-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 3.174631 Nov 24 03:03:47.051521 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Nov 24 03:03:43 2021] POST /compute/v2.1/os-volumes => generated 351 bytes in 3185 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 24 03:03:47.080981 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-94f03183-c025-4080-a12a-7a4bf588d61e tempest-VolumesGetTestJSON-708372623 tempest-VolumesGetTestJSON-708372623-project] Calling method '.version_select at 0x7f7a2fcd9160>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:03:47.476685 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-94f03183-c025-4080-a12a-7a4bf588d61e tempest-VolumesGetTestJSON-708372623 tempest-VolumesGetTestJSON-708372623-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6e70cddb-4802-4733-8408-acc2467590dd" status: 200 len: 351 microversion: 2.1 time: 0.415448 Nov 24 03:03:47.477606 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 2/2] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Nov 24 03:03:47 2021] GET /compute/v2.1/os-volumes/6e70cddb-4802-4733-8408-acc2467590dd => generated 351 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:03:47.598751 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-53adcdb7-1052-475d-b5ec-922e1ac01366 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1575227810", "imageRef": "04860a4a-47c3-4532-865d-be6c9c493af7", "flavorRef": "452", "networks": [{"uuid": "59dd1f41-1359-4909-9110-0b913837290f"}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:03:47.917827 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-53adcdb7-1052-475d-b5ec-922e1ac01366 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] validate_networks() for [('59dd1f41-1359-4909-9110-0b913837290f', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:03:48.615037 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-d8df8bd1-5eeb-470c-bb1e-f1657d1444e1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Flavor limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:03:48.615882 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-d8df8bd1-5eeb-470c-bb1e-f1657d1444e1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Image limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:03:48.616839 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-d8df8bd1-5eeb-470c-bb1e-f1657d1444e1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Flavor pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:03:48.617256 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-d8df8bd1-5eeb-470c-bb1e-f1657d1444e1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Image pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:03:48.618877 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-d8df8bd1-5eeb-470c-bb1e-f1657d1444e1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:03:48.664518 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d8df8bd1-5eeb-470c-bb1e-f1657d1444e1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:48.665010 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d8df8bd1-5eeb-470c-bb1e-f1657d1444e1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:48.666694 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d8df8bd1-5eeb-470c-bb1e-f1657d1444e1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:48.669252 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d8df8bd1-5eeb-470c-bb1e-f1657d1444e1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:48.746519 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-d8df8bd1-5eeb-470c-bb1e-f1657d1444e1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Getting quotas for project 0d8250c30ab9492ab167e4dd03c96be1. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:03:48.765580 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-d8df8bd1-5eeb-470c-bb1e-f1657d1444e1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Getting quotas for user 7721d1277c63459dacf166e44cacf3b5 and project 0d8250c30ab9492ab167e4dd03c96be1. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:03:48.808555 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-d8df8bd1-5eeb-470c-bb1e-f1657d1444e1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Going to run 1 instances... {{(pid=116331) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:03:48.815917 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-d8df8bd1-5eeb-470c-bb1e-f1657d1444e1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04860a4a-47c3-4532-865d-be6c9c493af7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:03:49.020883 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-d8df8bd1-5eeb-470c-bb1e-f1657d1444e1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.346231 Nov 24 03:03:49.021897 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Nov 24 03:03:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 4349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 03:03:49.033260 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b788d60d-1661-456e-bd31-f858b18ae76f tempest-VolumesGetTestJSON-708372623 tempest-VolumesGetTestJSON-708372623-project] Calling method '.version_select at 0x7f7a2fc7b430>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:03:49.202328 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b788d60d-1661-456e-bd31-f858b18ae76f tempest-VolumesGetTestJSON-708372623 tempest-VolumesGetTestJSON-708372623-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6e70cddb-4802-4733-8408-acc2467590dd" status: 200 len: 352 microversion: 2.1 time: 0.178886 Nov 24 03:03:49.209276 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Nov 24 03:03:49 2021] GET /compute/v2.1/os-volumes/6e70cddb-4802-4733-8408-acc2467590dd => generated 352 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:03:49.217759 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c3c6cd73-eae9-4d41-a64c-586c71b6e2de tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:03:49.217759 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c3c6cd73-eae9-4d41-a64c-586c71b6e2de tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:03:49.548482 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c3c6cd73-eae9-4d41-a64c-586c71b6e2de tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:03:49.575884 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c3c6cd73-eae9-4d41-a64c-586c71b6e2de tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1217 microversion: 2.1 time: 0.365377 Nov 24 03:03:49.585599 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 3/5] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:03:49 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1217 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:03:49.606741 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4cc6ec62-c18b-4db6-ab0d-520a305ca361 tempest-VolumesGetTestJSON-708372623 tempest-VolumesGetTestJSON-708372623-project] Calling method '.version_select at 0x7f7a2eb923a0>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:03:49.716249 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4cc6ec62-c18b-4db6-ab0d-520a305ca361 tempest-VolumesGetTestJSON-708372623 tempest-VolumesGetTestJSON-708372623-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6e70cddb-4802-4733-8408-acc2467590dd" status: 200 len: 352 microversion: 2.1 time: 0.138201 Nov 24 03:03:49.717769 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 4/6] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Nov 24 03:03:49 2021] GET /compute/v2.1/os-volumes/6e70cddb-4802-4733-8408-acc2467590dd => generated 352 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:03:49.741094 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-bea5298d-213c-4a3c-a048-12441cdeda49 tempest-VolumesGetTestJSON-708372623 tempest-VolumesGetTestJSON-708372623-project] Calling method '.version_select at 0x7f7a2eb7e310>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:03:49.952775 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-bea5298d-213c-4a3c-a048-12441cdeda49 tempest-VolumesGetTestJSON-708372623 tempest-VolumesGetTestJSON-708372623-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/6e70cddb-4802-4733-8408-acc2467590dd" status: 202 len: 0 microversion: 2.1 time: 0.217279 Nov 24 03:03:49.953786 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 5/7] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Nov 24 03:03:49 2021] DELETE /compute/v2.1/os-volumes/6e70cddb-4802-4733-8408-acc2467590dd => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 03:03:49.962403 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7b8822ea-3264-4f0b-9e28-90867e23e872 tempest-VolumesGetTestJSON-708372623 tempest-VolumesGetTestJSON-708372623-project] Calling method '.version_select at 0x7f7a2eb2a280>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:03:50.083560 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7b8822ea-3264-4f0b-9e28-90867e23e872 tempest-VolumesGetTestJSON-708372623 tempest-VolumesGetTestJSON-708372623-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6e70cddb-4802-4733-8408-acc2467590dd" status: 200 len: 351 microversion: 2.1 time: 0.125674 Nov 24 03:03:50.085760 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 6/8] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Nov 24 03:03:49 2021] GET /compute/v2.1/os-volumes/6e70cddb-4802-4733-8408-acc2467590dd => generated 351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:03:50.399092 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-53adcdb7-1052-475d-b5ec-922e1ac01366 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:03:50.399744 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-53adcdb7-1052-475d-b5ec-922e1ac01366 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:03:50.399986 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-53adcdb7-1052-475d-b5ec-922e1ac01366 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:03:50.400522 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-53adcdb7-1052-475d-b5ec-922e1ac01366 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:03:50.400794 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-53adcdb7-1052-475d-b5ec-922e1ac01366 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:03:50.453719 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-53adcdb7-1052-475d-b5ec-922e1ac01366 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:50.457782 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-53adcdb7-1052-475d-b5ec-922e1ac01366 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:50.458761 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-53adcdb7-1052-475d-b5ec-922e1ac01366 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:50.465967 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-53adcdb7-1052-475d-b5ec-922e1ac01366 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:50.562482 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-53adcdb7-1052-475d-b5ec-922e1ac01366 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Getting quotas for project 1550be2c2e954fe0b225bf7a5a4c2e3f. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:03:50.576054 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-53adcdb7-1052-475d-b5ec-922e1ac01366 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Getting quotas for user 912f1e73cdbe4c42986a15f827d15479 and project 1550be2c2e954fe0b225bf7a5a4c2e3f. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:03:50.592837 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-fcf54e45-4f12-4f80-87b0-8fdf504a6ca7 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:03:50.593851 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-fcf54e45-4f12-4f80-87b0-8fdf504a6ca7 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:03:50.624449 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-53adcdb7-1052-475d-b5ec-922e1ac01366 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:03:50.639588 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-53adcdb7-1052-475d-b5ec-922e1ac01366 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04860a4a-47c3-4532-865d-be6c9c493af7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:03:50.857039 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-fcf54e45-4f12-4f80-87b0-8fdf504a6ca7 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:03:50.871232 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-fcf54e45-4f12-4f80-87b0-8fdf504a6ca7 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1217 microversion: 2.1 time: 0.282297 Nov 24 03:03:50.872569 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-53adcdb7-1052-475d-b5ec-922e1ac01366 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.393799 Nov 24 03:03:50.878443 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 3/9] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Nov 24 03:03:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 3395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 03:03:50.883706 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 7/10] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:03:50 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1217 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:03:50.887534 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3973c6e6-d396-4972-9ff3-ce3e867f0730 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:03:50.888170 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3973c6e6-d396-4972-9ff3-ce3e867f0730 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:03:51.098145 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-9fc7e51a-49e7-4014-96c3-f970bca4f49c tempest-VolumesGetTestJSON-708372623 tempest-VolumesGetTestJSON-708372623-project] Calling method '.version_select at 0x7f7a2eb7ef70>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:03:51.182007 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-9fc7e51a-49e7-4014-96c3-f970bca4f49c tempest-VolumesGetTestJSON-708372623 tempest-VolumesGetTestJSON-708372623-project] HTTP exception thrown: Volume 6e70cddb-4802-4733-8408-acc2467590dd could not be found. Nov 24 03:03:51.183100 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-9fc7e51a-49e7-4014-96c3-f970bca4f49c tempest-VolumesGetTestJSON-708372623 tempest-VolumesGetTestJSON-708372623-project] Returning 404 to user: Volume 6e70cddb-4802-4733-8408-acc2467590dd could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:03:51.184244 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-9fc7e51a-49e7-4014-96c3-f970bca4f49c tempest-VolumesGetTestJSON-708372623 tempest-VolumesGetTestJSON-708372623-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6e70cddb-4802-4733-8408-acc2467590dd" status: 404 len: 109 microversion: 2.1 time: 0.091353 Nov 24 03:03:51.185270 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 8/11] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Nov 24 03:03:51 2021] GET /compute/v2.1/os-volumes/6e70cddb-4802-4733-8408-acc2467590dd => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:03:51.613400 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3973c6e6-d396-4972-9ff3-ce3e867f0730 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:03:51.656895 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3973c6e6-d396-4972-9ff3-ce3e867f0730 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1215 microversion: 2.1 time: 0.774114 Nov 24 03:03:51.662814 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 4/12] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:03:50 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1215 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:03:51.896111 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0a4c2963-e2b8-465f-8f00-9112063fa8e4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:03:51.898358 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0a4c2963-e2b8-465f-8f00-9112063fa8e4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:03:51.917469 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a4c2963-e2b8-465f-8f00-9112063fa8e4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:51.922460 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a4c2963-e2b8-465f-8f00-9112063fa8e4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:51.924031 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a4c2963-e2b8-465f-8f00-9112063fa8e4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:51.927708 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a4c2963-e2b8-465f-8f00-9112063fa8e4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:52.347220 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0a4c2963-e2b8-465f-8f00-9112063fa8e4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:03:52.374364 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0a4c2963-e2b8-465f-8f00-9112063fa8e4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1269 microversion: 2.1 time: 0.479814 Nov 24 03:03:52.375513 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 9/13] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:03:51 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1269 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:03:52.678809 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e171aa98-d009-4336-a4a5-d4630885d5e6 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:03:52.679973 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e171aa98-d009-4336-a4a5-d4630885d5e6 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:03:52.955100 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e171aa98-d009-4336-a4a5-d4630885d5e6 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:03:52.965957 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e171aa98-d009-4336-a4a5-d4630885d5e6 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1215 microversion: 2.1 time: 0.291033 Nov 24 03:03:52.973834 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 5/14] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:03:52 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1215 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:03:53.391157 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b35e973c-faff-468e-8da3-68145a233021 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:03:53.392468 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b35e973c-faff-468e-8da3-68145a233021 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:03:53.405402 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b35e973c-faff-468e-8da3-68145a233021 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:53.406867 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b35e973c-faff-468e-8da3-68145a233021 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:53.411312 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b35e973c-faff-468e-8da3-68145a233021 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:53.412030 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b35e973c-faff-468e-8da3-68145a233021 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:53.748826 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b35e973c-faff-468e-8da3-68145a233021 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:03:53.760809 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b35e973c-faff-468e-8da3-68145a233021 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1275 microversion: 2.1 time: 0.373165 Nov 24 03:03:53.764936 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 10/15] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:03:53 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1275 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:03:53.995620 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4b2692fc-999b-40db-b64d-e0f1f72458fe tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:03:53.999894 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4b2692fc-999b-40db-b64d-e0f1f72458fe tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:03:54.035380 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b2692fc-999b-40db-b64d-e0f1f72458fe tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:54.036115 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b2692fc-999b-40db-b64d-e0f1f72458fe tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:54.041969 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b2692fc-999b-40db-b64d-e0f1f72458fe tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:54.043155 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b2692fc-999b-40db-b64d-e0f1f72458fe tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:54.631212 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4b2692fc-999b-40db-b64d-e0f1f72458fe tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:03:54.656772 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4b2692fc-999b-40db-b64d-e0f1f72458fe tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1267 microversion: 2.1 time: 0.665252 Nov 24 03:03:54.660106 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 6/16] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:03:53 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1267 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:03:54.796490 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5c5d8c04-485e-4e89-9dc9-d578a627f0c7 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:03:54.797348 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-5c5d8c04-485e-4e89-9dc9-d578a627f0c7 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:03:54.836674 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5c5d8c04-485e-4e89-9dc9-d578a627f0c7 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:54.841246 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5c5d8c04-485e-4e89-9dc9-d578a627f0c7 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:54.844811 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5c5d8c04-485e-4e89-9dc9-d578a627f0c7 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:54.845868 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5c5d8c04-485e-4e89-9dc9-d578a627f0c7 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:55.568588 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5c5d8c04-485e-4e89-9dc9-d578a627f0c7 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:03:55.585314 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-5c5d8c04-485e-4e89-9dc9-d578a627f0c7 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1275 microversion: 2.1 time: 0.790442 Nov 24 03:03:55.587884 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 11/17] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:03:54 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1275 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:03:55.685307 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3fc7feb3-4e92-4056-baaf-a1f5b2a63142 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:03:55.685980 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3fc7feb3-4e92-4056-baaf-a1f5b2a63142 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:03:55.710933 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3fc7feb3-4e92-4056-baaf-a1f5b2a63142 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:55.711725 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3fc7feb3-4e92-4056-baaf-a1f5b2a63142 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:55.712883 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3fc7feb3-4e92-4056-baaf-a1f5b2a63142 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:55.713490 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3fc7feb3-4e92-4056-baaf-a1f5b2a63142 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:56.242295 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3fc7feb3-4e92-4056-baaf-a1f5b2a63142 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:03:56.252119 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3fc7feb3-4e92-4056-baaf-a1f5b2a63142 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1273 microversion: 2.1 time: 0.570738 Nov 24 03:03:56.263206 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 7/18] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:03:55 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1273 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:03:56.636577 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c706aa7f-2c35-4382-84f9-70f07253e280 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:03:56.636577 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c706aa7f-2c35-4382-84f9-70f07253e280 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:03:56.653534 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c706aa7f-2c35-4382-84f9-70f07253e280 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:56.654341 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c706aa7f-2c35-4382-84f9-70f07253e280 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:56.657966 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c706aa7f-2c35-4382-84f9-70f07253e280 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:56.658663 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c706aa7f-2c35-4382-84f9-70f07253e280 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:56.884601 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c706aa7f-2c35-4382-84f9-70f07253e280 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:03:56.894336 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c706aa7f-2c35-4382-84f9-70f07253e280 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1275 microversion: 2.1 time: 0.280438 Nov 24 03:03:56.910347 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 12/19] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:03:56 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1275 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:03:57.271704 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5a82dac1-f9c7-490d-897e-15add3f54b48 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:03:57.272740 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5a82dac1-f9c7-490d-897e-15add3f54b48 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:03:57.300735 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5a82dac1-f9c7-490d-897e-15add3f54b48 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:57.311199 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5a82dac1-f9c7-490d-897e-15add3f54b48 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:57.315118 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5a82dac1-f9c7-490d-897e-15add3f54b48 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:57.325197 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5a82dac1-f9c7-490d-897e-15add3f54b48 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:57.927214 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f01cc5c3-d8fa-4b9e-b02e-df6fd0889496 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:03:57.929969 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f01cc5c3-d8fa-4b9e-b02e-df6fd0889496 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:03:57.944451 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f01cc5c3-d8fa-4b9e-b02e-df6fd0889496 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:57.946477 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f01cc5c3-d8fa-4b9e-b02e-df6fd0889496 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:57.952299 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f01cc5c3-d8fa-4b9e-b02e-df6fd0889496 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:57.953593 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f01cc5c3-d8fa-4b9e-b02e-df6fd0889496 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:58.505558 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5a82dac1-f9c7-490d-897e-15add3f54b48 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:03:58.520978 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5a82dac1-f9c7-490d-897e-15add3f54b48 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1273 microversion: 2.1 time: 1.251553 Nov 24 03:03:58.522719 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 8/20] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:03:57 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1273 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:03:59.544526 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e3b79e75-f6ca-4f0e-ae26-62d4f7225e83 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:03:59.547890 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e3b79e75-f6ca-4f0e-ae26-62d4f7225e83 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:03:59.589457 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e3b79e75-f6ca-4f0e-ae26-62d4f7225e83 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:59.591842 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e3b79e75-f6ca-4f0e-ae26-62d4f7225e83 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:59.599322 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e3b79e75-f6ca-4f0e-ae26-62d4f7225e83 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:03:59.602248 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e3b79e75-f6ca-4f0e-ae26-62d4f7225e83 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:03:59.742336 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f01cc5c3-d8fa-4b9e-b02e-df6fd0889496 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:03:59.762438 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f01cc5c3-d8fa-4b9e-b02e-df6fd0889496 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1317 microversion: 2.1 time: 1.845667 Nov 24 03:03:59.765289 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 13/21] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:03:57 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1317 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:03:59.933885 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e3b79e75-f6ca-4f0e-ae26-62d4f7225e83 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:03:59.950365 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e3b79e75-f6ca-4f0e-ae26-62d4f7225e83 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1273 microversion: 2.1 time: 0.410492 Nov 24 03:03:59.957059 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 9/22] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:03:59 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1273 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:00.783355 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bed31c8d-613a-413c-8644-bbe6ce961dcc tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:00.785443 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bed31c8d-613a-413c-8644-bbe6ce961dcc tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:00.797490 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bed31c8d-613a-413c-8644-bbe6ce961dcc tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:00.798366 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bed31c8d-613a-413c-8644-bbe6ce961dcc tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:00.801420 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bed31c8d-613a-413c-8644-bbe6ce961dcc tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:00.802161 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bed31c8d-613a-413c-8644-bbe6ce961dcc tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:01.272227 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0201215a-141f-467f-a38e-e4d76061a24f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'create', calling method: .version_select at 0x7f7a2fe115e0>, body: {"keypair": {"name": "tempest-keypair-1540762650"}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:01.379045 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-0201215a-141f-467f-a38e-e4d76061a24f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Getting quotas for project 1d1fc30b25794d87bec45177a9dcfb88. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:04:01.389704 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-0201215a-141f-467f-a38e-e4d76061a24f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Getting quotas for user 1bbe87944f9c4cd292ec856f6ce7ccd7 and project 1d1fc30b25794d87bec45177a9dcfb88. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:04:01.497978 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-bed31c8d-613a-413c-8644-bbe6ce961dcc tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:01.513782 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bed31c8d-613a-413c-8644-bbe6ce961dcc tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1317 microversion: 2.1 time: 0.735769 Nov 24 03:04:01.530655 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 10/23] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:00 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1317 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:01.544152 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-752b0293-c8d6-4746-9589-75484cb0aba3 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:01.560159 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-752b0293-c8d6-4746-9589-75484cb0aba3 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:01.583936 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-752b0293-c8d6-4746-9589-75484cb0aba3 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:01.591413 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-752b0293-c8d6-4746-9589-75484cb0aba3 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:01.596465 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-752b0293-c8d6-4746-9589-75484cb0aba3 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:01.602877 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-752b0293-c8d6-4746-9589-75484cb0aba3 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:02.108660 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-752b0293-c8d6-4746-9589-75484cb0aba3 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:02.120999 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-752b0293-c8d6-4746-9589-75484cb0aba3 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1315 microversion: 2.1 time: 0.589100 Nov 24 03:04:02.123386 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 11/24] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:01 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:02.440975 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-0201215a-141f-467f-a38e-e4d76061a24f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Getting quotas for project 1d1fc30b25794d87bec45177a9dcfb88. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:04:02.452610 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-0201215a-141f-467f-a38e-e4d76061a24f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Getting quotas for user 1bbe87944f9c4cd292ec856f6ce7ccd7 and project 1d1fc30b25794d87bec45177a9dcfb88. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:04:02.505008 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0201215a-141f-467f-a38e-e4d76061a24f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.745765 Nov 24 03:04:02.507398 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 14/25] 10.222.0.52 () {62 vars in 1198 bytes} [Wed Nov 24 03:04:00 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1753 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 24 03:04:02.548338 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a8289739-b7d6-4504-a0b9-cd270ffb457a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:02.554924 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a8289739-b7d6-4504-a0b9-cd270ffb457a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:02.585748 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a8289739-b7d6-4504-a0b9-cd270ffb457a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:02.588137 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a8289739-b7d6-4504-a0b9-cd270ffb457a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:02.590756 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a8289739-b7d6-4504-a0b9-cd270ffb457a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:02.592974 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a8289739-b7d6-4504-a0b9-cd270ffb457a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:03.231181 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-79bc7d60-7c64-43eb-a294-23d511dd3bca tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-177561284", "imageRef": "04860a4a-47c3-4532-865d-be6c9c493af7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "639b791b-23eb-4a2f-83f9-9afa251f8e43"}]}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:03.371882 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.network.neutron [None req-79bc7d60-7c64-43eb-a294-23d511dd3bca tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] validate_networks() for [('639b791b-23eb-4a2f-83f9-9afa251f8e43', None, None, None, None, None)] {{(pid=116331) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:04:04.090987 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a8289739-b7d6-4504-a0b9-cd270ffb457a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:04.105357 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a8289739-b7d6-4504-a0b9-cd270ffb457a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1317 microversion: 2.1 time: 1.563036 Nov 24 03:04:04.118037 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 12/26] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:02 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1317 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:04.125241 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-dcbb1cf0-776d-498f-b79d-76895b7564bd tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:04.131481 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-dcbb1cf0-776d-498f-b79d-76895b7564bd tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:04.165698 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dcbb1cf0-776d-498f-b79d-76895b7564bd tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:04.169239 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dcbb1cf0-776d-498f-b79d-76895b7564bd tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:04.172775 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dcbb1cf0-776d-498f-b79d-76895b7564bd tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:04.173410 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dcbb1cf0-776d-498f-b79d-76895b7564bd tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:06.048901 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-dcbb1cf0-776d-498f-b79d-76895b7564bd tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:06.075543 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-dcbb1cf0-776d-498f-b79d-76895b7564bd tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1315 microversion: 2.1 time: 1.956156 Nov 24 03:04:06.088508 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 13/27] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:04 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1315 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:06.093240 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-cf26f394-230a-4340-91db-89f7ba32063e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:06.094280 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-cf26f394-230a-4340-91db-89f7ba32063e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:06.105882 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cf26f394-230a-4340-91db-89f7ba32063e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:06.107234 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cf26f394-230a-4340-91db-89f7ba32063e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:06.108549 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cf26f394-230a-4340-91db-89f7ba32063e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:06.112333 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cf26f394-230a-4340-91db-89f7ba32063e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:06.611947 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-79bc7d60-7c64-43eb-a294-23d511dd3bca tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Flavor limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:04:06.613540 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-79bc7d60-7c64-43eb-a294-23d511dd3bca tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Image limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:04:06.613540 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-79bc7d60-7c64-43eb-a294-23d511dd3bca tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Flavor pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:04:06.613852 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-79bc7d60-7c64-43eb-a294-23d511dd3bca tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Image pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:04:06.614552 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-79bc7d60-7c64-43eb-a294-23d511dd3bca tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:04:06.644446 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-79bc7d60-7c64-43eb-a294-23d511dd3bca tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:06.648527 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-79bc7d60-7c64-43eb-a294-23d511dd3bca tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:06.654181 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-79bc7d60-7c64-43eb-a294-23d511dd3bca tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:06.656430 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-79bc7d60-7c64-43eb-a294-23d511dd3bca tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:06.723380 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-79bc7d60-7c64-43eb-a294-23d511dd3bca tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Getting quotas for project 183208d9e5a24b759edb898c961eaa4f. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:04:06.734761 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-79bc7d60-7c64-43eb-a294-23d511dd3bca tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Getting quotas for user 1d1889aa91484766bf6bebe407431936 and project 183208d9e5a24b759edb898c961eaa4f. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:04:06.791550 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-79bc7d60-7c64-43eb-a294-23d511dd3bca tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Going to run 1 instances... {{(pid=116331) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:04:06.798391 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-79bc7d60-7c64-43eb-a294-23d511dd3bca tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04860a4a-47c3-4532-865d-be6c9c493af7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:04:06.979586 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-79bc7d60-7c64-43eb-a294-23d511dd3bca tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.195564 Nov 24 03:04:06.982877 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 15/28] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Nov 24 03:04:02 2021] POST /compute/v2.1/servers => generated 383 bytes in 4203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 03:04:07.000814 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c3ef4900-aebd-4fdc-b721-5070c4be37d4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:07.017070 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c3ef4900-aebd-4fdc-b721-5070c4be37d4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:07.413981 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c3ef4900-aebd-4fdc-b721-5070c4be37d4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:07.430033 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c3ef4900-aebd-4fdc-b721-5070c4be37d4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1221 microversion: 2.1 time: 0.431379 Nov 24 03:04:07.433365 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 16/29] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:06 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1221 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:07.455956 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c0670d16-a68b-46ce-b772-6093cb0f2833 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:07.464699 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c0670d16-a68b-46ce-b772-6093cb0f2833 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:07.505270 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c0670d16-a68b-46ce-b772-6093cb0f2833 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:07.508033 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c0670d16-a68b-46ce-b772-6093cb0f2833 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:07.516793 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c0670d16-a68b-46ce-b772-6093cb0f2833 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:07.521404 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c0670d16-a68b-46ce-b772-6093cb0f2833 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:08.556095 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-cf26f394-230a-4340-91db-89f7ba32063e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:08.574426 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-cf26f394-230a-4340-91db-89f7ba32063e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1317 microversion: 2.1 time: 2.491963 Nov 24 03:04:08.590509 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 14/30] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:06 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1317 bytes in 2509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:08.604802 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b9e1d13a-0555-453a-bf0a-6adbdf68bc26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-242078515", "imageRef": "04860a4a-47c3-4532-865d-be6c9c493af7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "639b791b-23eb-4a2f-83f9-9afa251f8e43"}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:08.753765 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-b9e1d13a-0555-453a-bf0a-6adbdf68bc26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] validate_networks() for [('639b791b-23eb-4a2f-83f9-9afa251f8e43', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:04:09.843113 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c0670d16-a68b-46ce-b772-6093cb0f2833 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:09.871179 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c0670d16-a68b-46ce-b772-6093cb0f2833 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1315 microversion: 2.1 time: 2.430648 Nov 24 03:04:09.871809 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 17/31] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:07 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1315 bytes in 2437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:10.193028 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-d0778b15-7263-4fdc-a701-9ab93b4f91ef req-ac8fb301-a408-43a7-bb57-84b90adf9dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7336735a-138d-4072-a48b-30b6741211cb", "tag": "2c9cdbfc-f976-4a05-b58d-e0d5a3660703"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:10.196204 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:04:10.196204 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:04:10.222012 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-d0778b15-7263-4fdc-a701-9ab93b4f91ef req-ac8fb301-a408-43a7-bb57-84b90adf9dc0 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:10.222770 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-d0778b15-7263-4fdc-a701-9ab93b4f91ef req-ac8fb301-a408-43a7-bb57-84b90adf9dc0 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:10.282889 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-d0778b15-7263-4fdc-a701-9ab93b4f91ef req-ac8fb301-a408-43a7-bb57-84b90adf9dc0 service nova] Creating event network-changed:2c9cdbfc-f976-4a05-b58d-e0d5a3660703 for instance 7336735a-138d-4072-a48b-30b6741211cb on hv-cinder-81803 Nov 24 03:04:10.285277 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-d0778b15-7263-4fdc-a701-9ab93b4f91ef req-ac8fb301-a408-43a7-bb57-84b90adf9dc0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 24 03:04:10.289400 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-61a31b88-b9da-4816-ae38-cc1861af6142 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:10.290355 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-61a31b88-b9da-4816-ae38-cc1861af6142 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:10.293690 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-61a31b88-b9da-4816-ae38-cc1861af6142 None None] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:10.295948 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-61a31b88-b9da-4816-ae38-cc1861af6142 None None] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:10.332624 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.compute.rpcapi [None req-61a31b88-b9da-4816-ae38-cc1861af6142 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 24 03:04:10.335080 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-61a31b88-b9da-4816-ae38-cc1861af6142 None None] Releasing lock "compute-rpcapi-router" {{(pid=116331) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 24 03:04:10.492450 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-61a31b88-b9da-4816-ae38-cc1861af6142 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.601663 Nov 24 03:04:10.495644 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 18/32] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:04:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:04:11.159223 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-b8a095a1-ae27-4718-8973-9388a19b639e req-05fb9c7e-1475-444a-a1fe-802f0385f2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a175fec-cd0a-49a4-a612-b3698836edef", "tag": "2d767caa-bca8-41a0-b79c-dbef07431926"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:11.161762 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:04:11.161762 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:04:11.182554 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-b8a095a1-ae27-4718-8973-9388a19b639e req-05fb9c7e-1475-444a-a1fe-802f0385f2a8 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:11.184515 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-b8a095a1-ae27-4718-8973-9388a19b639e req-05fb9c7e-1475-444a-a1fe-802f0385f2a8 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:11.213571 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-b8a095a1-ae27-4718-8973-9388a19b639e req-05fb9c7e-1475-444a-a1fe-802f0385f2a8 service nova] Creating event network-changed:2d767caa-bca8-41a0-b79c-dbef07431926 for instance 9a175fec-cd0a-49a4-a612-b3698836edef on hv-cinder-81803 Nov 24 03:04:11.219619 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-b8a095a1-ae27-4718-8973-9388a19b639e req-05fb9c7e-1475-444a-a1fe-802f0385f2a8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.717361 Nov 24 03:04:11.220617 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 19/33] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:04:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:04:11.227697 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c1336cec-3dc9-44e4-81f1-48af7123458c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:11.228748 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c1336cec-3dc9-44e4-81f1-48af7123458c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:11.237247 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c1336cec-3dc9-44e4-81f1-48af7123458c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:11.238063 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c1336cec-3dc9-44e4-81f1-48af7123458c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:11.239168 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c1336cec-3dc9-44e4-81f1-48af7123458c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:11.239760 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c1336cec-3dc9-44e4-81f1-48af7123458c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:11.716272 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c1336cec-3dc9-44e4-81f1-48af7123458c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:11.740866 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c1336cec-3dc9-44e4-81f1-48af7123458c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1317 microversion: 2.1 time: 0.513590 Nov 24 03:04:11.742508 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 20/34] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:11 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:11.752767 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-d00804ea-1194-46c4-bd15-fbe037502041 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:11.753875 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-d00804ea-1194-46c4-bd15-fbe037502041 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:11.772106 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d00804ea-1194-46c4-bd15-fbe037502041 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:11.773100 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d00804ea-1194-46c4-bd15-fbe037502041 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:11.774841 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d00804ea-1194-46c4-bd15-fbe037502041 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:11.775772 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d00804ea-1194-46c4-bd15-fbe037502041 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:11.878466 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-b9e1d13a-0555-453a-bf0a-6adbdf68bc26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:04:11.880356 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-b9e1d13a-0555-453a-bf0a-6adbdf68bc26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:04:11.881885 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-b9e1d13a-0555-453a-bf0a-6adbdf68bc26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:04:11.883852 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-b9e1d13a-0555-453a-bf0a-6adbdf68bc26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:04:11.884808 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-b9e1d13a-0555-453a-bf0a-6adbdf68bc26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:04:11.915499 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b9e1d13a-0555-453a-bf0a-6adbdf68bc26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:11.916025 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b9e1d13a-0555-453a-bf0a-6adbdf68bc26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:11.918357 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b9e1d13a-0555-453a-bf0a-6adbdf68bc26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:11.921794 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b9e1d13a-0555-453a-bf0a-6adbdf68bc26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:11.958975 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-b9e1d13a-0555-453a-bf0a-6adbdf68bc26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Getting quotas for project 183208d9e5a24b759edb898c961eaa4f. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:04:11.963937 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-b9e1d13a-0555-453a-bf0a-6adbdf68bc26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Getting quotas for user 1d1889aa91484766bf6bebe407431936 and project 183208d9e5a24b759edb898c961eaa4f. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:04:11.980979 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b9e1d13a-0555-453a-bf0a-6adbdf68bc26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:04:11.983554 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b9e1d13a-0555-453a-bf0a-6adbdf68bc26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04860a4a-47c3-4532-865d-be6c9c493af7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:04:12.052346 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b9e1d13a-0555-453a-bf0a-6adbdf68bc26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.460166 Nov 24 03:04:12.053294 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 15/35] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Nov 24 03:04:08 2021] POST /compute/v2.1/servers => generated 383 bytes in 3462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 03:04:12.080368 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6b04e29d-13e6-4782-8484-6b5a7d442a46 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:12.084329 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6b04e29d-13e6-4782-8484-6b5a7d442a46 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:12.198047 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6b04e29d-13e6-4782-8484-6b5a7d442a46 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:12.209075 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6b04e29d-13e6-4782-8484-6b5a7d442a46 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1221 microversion: 2.1 time: 0.137471 Nov 24 03:04:12.210250 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 16/36] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:12 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1221 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:12.408069 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-d00804ea-1194-46c4-bd15-fbe037502041 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:12.417966 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-d00804ea-1194-46c4-bd15-fbe037502041 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1315 microversion: 2.1 time: 0.673743 Nov 24 03:04:12.418630 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 21/37] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:11 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1315 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:12.775056 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-89169a72-9fb3-4bf0-8d03-9f0267c06a55 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:12.776993 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-89169a72-9fb3-4bf0-8d03-9f0267c06a55 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:12.791667 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-89169a72-9fb3-4bf0-8d03-9f0267c06a55 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:12.792714 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-89169a72-9fb3-4bf0-8d03-9f0267c06a55 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:12.794553 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-89169a72-9fb3-4bf0-8d03-9f0267c06a55 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:12.795745 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-89169a72-9fb3-4bf0-8d03-9f0267c06a55 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:13.057563 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-89169a72-9fb3-4bf0-8d03-9f0267c06a55 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:13.071996 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-89169a72-9fb3-4bf0-8d03-9f0267c06a55 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1317 microversion: 2.1 time: 0.304510 Nov 24 03:04:13.073894 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 17/38] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:12 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:13.239439 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-298c2eb1-ade5-4587-bbe1-c8ccb272f031 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:13.240973 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-298c2eb1-ade5-4587-bbe1-c8ccb272f031 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:13.261751 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-298c2eb1-ade5-4587-bbe1-c8ccb272f031 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:13.263201 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-298c2eb1-ade5-4587-bbe1-c8ccb272f031 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:13.266267 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-298c2eb1-ade5-4587-bbe1-c8ccb272f031 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:13.269349 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-298c2eb1-ade5-4587-bbe1-c8ccb272f031 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:13.430145 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-298c2eb1-ade5-4587-bbe1-c8ccb272f031 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:13.440208 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-298c2eb1-ade5-4587-bbe1-c8ccb272f031 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1225 microversion: 2.1 time: 0.209273 Nov 24 03:04:13.441694 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 22/39] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:13 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1225 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:13.447534 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a8dda147-2ef5-480b-9df8-2764826ac5d5 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:13.448560 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a8dda147-2ef5-480b-9df8-2764826ac5d5 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:13.458264 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a8dda147-2ef5-480b-9df8-2764826ac5d5 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:13.458725 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a8dda147-2ef5-480b-9df8-2764826ac5d5 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:13.460047 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a8dda147-2ef5-480b-9df8-2764826ac5d5 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:13.460906 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a8dda147-2ef5-480b-9df8-2764826ac5d5 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:13.711223 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a8dda147-2ef5-480b-9df8-2764826ac5d5 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:13.726060 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a8dda147-2ef5-480b-9df8-2764826ac5d5 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1315 microversion: 2.1 time: 0.282543 Nov 24 03:04:13.756526 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 18/40] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:13 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:13.976597 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0d722bc2-6bf2-44e5-80ab-1d6ca5e22a4e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-406397820", "imageRef": "04860a4a-47c3-4532-865d-be6c9c493af7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "66c8762d-888d-42b7-8906-192e168df98c"}], "security_groups": [{"name": "tempest-securitygroup--1898055156"}], "key_name": "tempest-keypair-1540762650", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:14.107164 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9f458dc5-d83e-4cbb-80e5-40fe8e87ffe9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:14.108441 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9f458dc5-d83e-4cbb-80e5-40fe8e87ffe9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:14.117555 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9f458dc5-d83e-4cbb-80e5-40fe8e87ffe9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:14.118553 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9f458dc5-d83e-4cbb-80e5-40fe8e87ffe9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:14.120561 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9f458dc5-d83e-4cbb-80e5-40fe8e87ffe9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:14.122284 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9f458dc5-d83e-4cbb-80e5-40fe8e87ffe9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:14.193352 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.network.neutron [None req-0d722bc2-6bf2-44e5-80ab-1d6ca5e22a4e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] validate_networks() for [('66c8762d-888d-42b7-8906-192e168df98c', None, None, None, None, None)] {{(pid=116331) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:04:14.495776 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9f458dc5-d83e-4cbb-80e5-40fe8e87ffe9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:14.530510 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9f458dc5-d83e-4cbb-80e5-40fe8e87ffe9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1317 microversion: 2.1 time: 0.432694 Nov 24 03:04:14.554212 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 19/41] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:14 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1317 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:14.587287 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ca649471-643e-4ccf-ac9e-ded7ff829a3a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:14.590166 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ca649471-643e-4ccf-ac9e-ded7ff829a3a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:14.605949 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca649471-643e-4ccf-ac9e-ded7ff829a3a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:14.609883 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca649471-643e-4ccf-ac9e-ded7ff829a3a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:14.614563 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca649471-643e-4ccf-ac9e-ded7ff829a3a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:14.619204 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca649471-643e-4ccf-ac9e-ded7ff829a3a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:15.065617 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ca649471-643e-4ccf-ac9e-ded7ff829a3a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:15.098984 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ca649471-643e-4ccf-ac9e-ded7ff829a3a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1225 microversion: 2.1 time: 0.541094 Nov 24 03:04:15.110303 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 20/42] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:14 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1225 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:15.124120 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-28d4d45f-b0ad-4e8a-a80d-834508f004f3 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:15.125803 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-28d4d45f-b0ad-4e8a-a80d-834508f004f3 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:15.167995 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-28d4d45f-b0ad-4e8a-a80d-834508f004f3 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:15.168796 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-28d4d45f-b0ad-4e8a-a80d-834508f004f3 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:15.171171 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-28d4d45f-b0ad-4e8a-a80d-834508f004f3 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:15.172430 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-28d4d45f-b0ad-4e8a-a80d-834508f004f3 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:15.553431 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-0d722bc2-6bf2-44e5-80ab-1d6ca5e22a4e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Flavor limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:04:15.554658 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-0d722bc2-6bf2-44e5-80ab-1d6ca5e22a4e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Image limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:04:15.555608 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-0d722bc2-6bf2-44e5-80ab-1d6ca5e22a4e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Flavor pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:04:15.557176 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-0d722bc2-6bf2-44e5-80ab-1d6ca5e22a4e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Image pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:04:15.557176 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-0d722bc2-6bf2-44e5-80ab-1d6ca5e22a4e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:04:15.629624 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0d722bc2-6bf2-44e5-80ab-1d6ca5e22a4e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:15.639482 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0d722bc2-6bf2-44e5-80ab-1d6ca5e22a4e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:15.641114 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0d722bc2-6bf2-44e5-80ab-1d6ca5e22a4e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:15.652202 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0d722bc2-6bf2-44e5-80ab-1d6ca5e22a4e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:15.756302 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-0d722bc2-6bf2-44e5-80ab-1d6ca5e22a4e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Getting quotas for project 1d1fc30b25794d87bec45177a9dcfb88. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:04:15.773307 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-0d722bc2-6bf2-44e5-80ab-1d6ca5e22a4e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Getting quotas for user 1bbe87944f9c4cd292ec856f6ce7ccd7 and project 1d1fc30b25794d87bec45177a9dcfb88. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:04:15.823719 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0d722bc2-6bf2-44e5-80ab-1d6ca5e22a4e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Going to run 1 instances... {{(pid=116331) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:04:15.831937 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0d722bc2-6bf2-44e5-80ab-1d6ca5e22a4e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04860a4a-47c3-4532-865d-be6c9c493af7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:04:15.968532 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0d722bc2-6bf2-44e5-80ab-1d6ca5e22a4e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.998304 Nov 24 03:04:15.970919 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 23/43] 10.222.0.52 () {62 vars in 1187 bytes} [Wed Nov 24 03:04:13 2021] POST /compute/v2.1/servers => generated 402 bytes in 2003 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 24 03:04:16.000890 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b6687dec-1c33-45b8-9b21-c022cbb90058 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:16.004398 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b6687dec-1c33-45b8-9b21-c022cbb90058 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:16.037356 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b6687dec-1c33-45b8-9b21-c022cbb90058 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:16.040847 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b6687dec-1c33-45b8-9b21-c022cbb90058 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:16.044936 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b6687dec-1c33-45b8-9b21-c022cbb90058 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:16.050779 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b6687dec-1c33-45b8-9b21-c022cbb90058 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:16.745402 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-28d4d45f-b0ad-4e8a-a80d-834508f004f3 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:16.780779 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-28d4d45f-b0ad-4e8a-a80d-834508f004f3 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1315 microversion: 2.1 time: 1.674251 Nov 24 03:04:16.811782 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 21/44] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:15 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1315 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:16.830086 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5290748e-812c-4d3a-a40c-9045f7fed8a0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:16.834814 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5290748e-812c-4d3a-a40c-9045f7fed8a0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:16.926277 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b6687dec-1c33-45b8-9b21-c022cbb90058 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:16.942140 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b6687dec-1c33-45b8-9b21-c022cbb90058 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1317 microversion: 2.1 time: 0.967638 Nov 24 03:04:16.946397 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 24/45] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:15 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1317 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:16.974497 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-43db9083-65cf-444a-b7fa-a150364f8976 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:16.979865 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-43db9083-65cf-444a-b7fa-a150364f8976 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:17.012972 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-43db9083-65cf-444a-b7fa-a150364f8976 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:17.014398 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-43db9083-65cf-444a-b7fa-a150364f8976 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:17.027769 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-43db9083-65cf-444a-b7fa-a150364f8976 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:17.031080 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-43db9083-65cf-444a-b7fa-a150364f8976 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:17.255686 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5290748e-812c-4d3a-a40c-9045f7fed8a0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:17.285114 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5290748e-812c-4d3a-a40c-9045f7fed8a0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:17.294457 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5290748e-812c-4d3a-a40c-9045f7fed8a0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:17.302391 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5290748e-812c-4d3a-a40c-9045f7fed8a0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1281 microversion: 2.20 time: 0.488387 Nov 24 03:04:17.308818 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 22/46] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:04:16 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1281 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:04:17.387021 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-43db9083-65cf-444a-b7fa-a150364f8976 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:17.435017 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-43db9083-65cf-444a-b7fa-a150364f8976 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1279 microversion: 2.1 time: 0.484586 Nov 24 03:04:17.456109 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 25/47] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:16 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1279 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:17.815332 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-70588fae-996e-40fe-aad8-e368f6a38dc1 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:17.819845 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-70588fae-996e-40fe-aad8-e368f6a38dc1 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:17.860665 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-70588fae-996e-40fe-aad8-e368f6a38dc1 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:17.861571 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-70588fae-996e-40fe-aad8-e368f6a38dc1 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:17.864014 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-70588fae-996e-40fe-aad8-e368f6a38dc1 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:17.864822 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-70588fae-996e-40fe-aad8-e368f6a38dc1 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:17.976942 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-57ac00c2-2ca9-436c-bcfd-3651bd2a6a4d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:17.982067 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-57ac00c2-2ca9-436c-bcfd-3651bd2a6a4d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:18.010537 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-57ac00c2-2ca9-436c-bcfd-3651bd2a6a4d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:18.014213 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-57ac00c2-2ca9-436c-bcfd-3651bd2a6a4d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:18.016037 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-57ac00c2-2ca9-436c-bcfd-3651bd2a6a4d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:18.019616 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-57ac00c2-2ca9-436c-bcfd-3651bd2a6a4d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:18.413548 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-57ac00c2-2ca9-436c-bcfd-3651bd2a6a4d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:18.427804 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-57ac00c2-2ca9-436c-bcfd-3651bd2a6a4d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1317 microversion: 2.1 time: 0.458910 Nov 24 03:04:18.429152 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 26/48] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:17 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:18.435000 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-587e76fd-ada1-4384-8bd8-4c0cbb9dce57 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:18.436086 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-587e76fd-ada1-4384-8bd8-4c0cbb9dce57 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:18.455621 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-587e76fd-ada1-4384-8bd8-4c0cbb9dce57 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:18.456369 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-587e76fd-ada1-4384-8bd8-4c0cbb9dce57 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:18.457462 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-587e76fd-ada1-4384-8bd8-4c0cbb9dce57 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:18.458210 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-587e76fd-ada1-4384-8bd8-4c0cbb9dce57 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:18.535102 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-70588fae-996e-40fe-aad8-e368f6a38dc1 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:18.547339 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-70588fae-996e-40fe-aad8-e368f6a38dc1 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1315 microversion: 2.1 time: 0.742242 Nov 24 03:04:18.548604 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 23/49] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:17 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:18.570882 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2739abfc-3016-49e4-aab5-7e62fa81ac9f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:18.571602 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2739abfc-3016-49e4-aab5-7e62fa81ac9f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:18.599068 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2739abfc-3016-49e4-aab5-7e62fa81ac9f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:18.599504 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2739abfc-3016-49e4-aab5-7e62fa81ac9f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:18.600363 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2739abfc-3016-49e4-aab5-7e62fa81ac9f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:18.600823 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2739abfc-3016-49e4-aab5-7e62fa81ac9f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:18.689869 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-587e76fd-ada1-4384-8bd8-4c0cbb9dce57 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:18.706397 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-587e76fd-ada1-4384-8bd8-4c0cbb9dce57 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:18.714256 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-587e76fd-ada1-4384-8bd8-4c0cbb9dce57 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:18.718208 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-587e76fd-ada1-4384-8bd8-4c0cbb9dce57 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1333 microversion: 2.20 time: 0.284167 Nov 24 03:04:18.719088 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 27/50] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:04:18 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1333 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:04:18.778625 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2739abfc-3016-49e4-aab5-7e62fa81ac9f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:18.787241 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2739abfc-3016-49e4-aab5-7e62fa81ac9f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1279 microversion: 2.1 time: 0.236986 Nov 24 03:04:18.790461 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 24/51] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:18 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1279 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:19.458982 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f565f4b1-35ab-438a-9187-0dda9db6eae0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:19.460599 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f565f4b1-35ab-438a-9187-0dda9db6eae0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:19.475801 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f565f4b1-35ab-438a-9187-0dda9db6eae0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:19.477191 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f565f4b1-35ab-438a-9187-0dda9db6eae0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:19.481456 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f565f4b1-35ab-438a-9187-0dda9db6eae0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:19.482524 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f565f4b1-35ab-438a-9187-0dda9db6eae0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:19.578154 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-83eab1dc-1425-4f47-985e-bbb729ed6610 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:19.579026 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-83eab1dc-1425-4f47-985e-bbb729ed6610 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:19.589348 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-83eab1dc-1425-4f47-985e-bbb729ed6610 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:19.590594 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-83eab1dc-1425-4f47-985e-bbb729ed6610 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:19.591722 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-83eab1dc-1425-4f47-985e-bbb729ed6610 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:19.592374 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-83eab1dc-1425-4f47-985e-bbb729ed6610 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:19.884177 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f565f4b1-35ab-438a-9187-0dda9db6eae0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:19.898406 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f565f4b1-35ab-438a-9187-0dda9db6eae0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1317 microversion: 2.1 time: 0.443494 Nov 24 03:04:19.900343 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 28/52] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:19 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:19.910454 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-83eab1dc-1425-4f47-985e-bbb729ed6610 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:19.920503 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-45ec8479-63c7-4a0b-96fa-c525da6315e5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:19.921907 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-45ec8479-63c7-4a0b-96fa-c525da6315e5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:19.924608 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-83eab1dc-1425-4f47-985e-bbb729ed6610 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1315 microversion: 2.1 time: 0.351049 Nov 24 03:04:19.926679 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 25/53] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:19 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:19.941597 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d4c12948-14f1-4248-818a-914748d036d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:19.944115 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d4c12948-14f1-4248-818a-914748d036d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:19.949448 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-45ec8479-63c7-4a0b-96fa-c525da6315e5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:19.950602 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-45ec8479-63c7-4a0b-96fa-c525da6315e5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:19.952334 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-45ec8479-63c7-4a0b-96fa-c525da6315e5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:19.953395 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-45ec8479-63c7-4a0b-96fa-c525da6315e5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:19.957489 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d4c12948-14f1-4248-818a-914748d036d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:19.958753 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d4c12948-14f1-4248-818a-914748d036d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:19.960348 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d4c12948-14f1-4248-818a-914748d036d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:19.961665 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d4c12948-14f1-4248-818a-914748d036d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:20.062581 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-45ec8479-63c7-4a0b-96fa-c525da6315e5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:20.072697 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-45ec8479-63c7-4a0b-96fa-c525da6315e5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:20.074632 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-45ec8479-63c7-4a0b-96fa-c525da6315e5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:20.075871 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-45ec8479-63c7-4a0b-96fa-c525da6315e5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1333 microversion: 2.20 time: 0.173906 Nov 24 03:04:20.076465 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 29/54] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:04:19 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1333 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:04:20.282969 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d4c12948-14f1-4248-818a-914748d036d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:20.297023 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d4c12948-14f1-4248-818a-914748d036d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1321 microversion: 2.1 time: 0.366382 Nov 24 03:04:20.298035 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 26/55] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:19 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:20.920547 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0583a89a-01af-42fd-986c-4ade68ef37ba tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:20.923007 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0583a89a-01af-42fd-986c-4ade68ef37ba tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:20.936823 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0583a89a-01af-42fd-986c-4ade68ef37ba tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:20.939004 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0583a89a-01af-42fd-986c-4ade68ef37ba tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:20.940799 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0583a89a-01af-42fd-986c-4ade68ef37ba tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:20.941783 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0583a89a-01af-42fd-986c-4ade68ef37ba tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:20.958032 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e6343e14-f11c-473f-8728-13d093099c90 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:20.959951 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e6343e14-f11c-473f-8728-13d093099c90 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:20.978753 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e6343e14-f11c-473f-8728-13d093099c90 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:20.979622 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e6343e14-f11c-473f-8728-13d093099c90 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:20.982980 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e6343e14-f11c-473f-8728-13d093099c90 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:20.986177 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e6343e14-f11c-473f-8728-13d093099c90 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:21.431916 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0583a89a-01af-42fd-986c-4ade68ef37ba tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:21.447655 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0583a89a-01af-42fd-986c-4ade68ef37ba tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1317 microversion: 2.1 time: 0.532052 Nov 24 03:04:21.451238 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 30/56] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:20 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:21.479803 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-12cd9d42-6466-4628-966e-92e86e194b4f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:21.484389 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-12cd9d42-6466-4628-966e-92e86e194b4f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:21.508630 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-12cd9d42-6466-4628-966e-92e86e194b4f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:21.511037 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-12cd9d42-6466-4628-966e-92e86e194b4f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:21.515846 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-12cd9d42-6466-4628-966e-92e86e194b4f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:21.516331 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-12cd9d42-6466-4628-966e-92e86e194b4f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:21.699635 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-12cd9d42-6466-4628-966e-92e86e194b4f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:21.717659 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-12cd9d42-6466-4628-966e-92e86e194b4f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:21.720282 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-12cd9d42-6466-4628-966e-92e86e194b4f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:21.723501 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-12cd9d42-6466-4628-966e-92e86e194b4f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1351 microversion: 2.20 time: 0.269845 Nov 24 03:04:21.724408 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 31/57] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:04:21 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1351 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:04:21.739510 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-09a38654-4272-4e2f-9dcf-d0d92b2f617d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:21.747330 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-09a38654-4272-4e2f-9dcf-d0d92b2f617d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:21.764158 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-09a38654-4272-4e2f-9dcf-d0d92b2f617d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:21.764994 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-09a38654-4272-4e2f-9dcf-d0d92b2f617d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:21.766106 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-09a38654-4272-4e2f-9dcf-d0d92b2f617d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:21.766800 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-09a38654-4272-4e2f-9dcf-d0d92b2f617d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:21.979472 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e6343e14-f11c-473f-8728-13d093099c90 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:22.007605 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e6343e14-f11c-473f-8728-13d093099c90 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1315 microversion: 2.1 time: 1.056780 Nov 24 03:04:22.009036 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 27/58] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:20 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1315 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:22.451924 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-09a38654-4272-4e2f-9dcf-d0d92b2f617d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:22.484789 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-36e7feab-40b1-47c2-aeba-5c370dab811d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:22.485880 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-36e7feab-40b1-47c2-aeba-5c370dab811d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:22.494982 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-09a38654-4272-4e2f-9dcf-d0d92b2f617d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1321 microversion: 2.1 time: 0.761005 Nov 24 03:04:22.496042 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 32/59] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:21 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1321 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:22.538793 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36e7feab-40b1-47c2-aeba-5c370dab811d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:22.540662 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36e7feab-40b1-47c2-aeba-5c370dab811d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:22.548059 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36e7feab-40b1-47c2-aeba-5c370dab811d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:22.548850 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36e7feab-40b1-47c2-aeba-5c370dab811d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:22.759547 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-80a5817b-6a7e-4223-ba56-479f69254841 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:22.762505 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-80a5817b-6a7e-4223-ba56-479f69254841 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:22.791118 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-80a5817b-6a7e-4223-ba56-479f69254841 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:22.792071 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-80a5817b-6a7e-4223-ba56-479f69254841 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:22.793943 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-80a5817b-6a7e-4223-ba56-479f69254841 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:22.794842 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-80a5817b-6a7e-4223-ba56-479f69254841 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:22.929336 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-80a5817b-6a7e-4223-ba56-479f69254841 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:22.942159 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-80a5817b-6a7e-4223-ba56-479f69254841 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:22.943899 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-80a5817b-6a7e-4223-ba56-479f69254841 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:22.945112 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-80a5817b-6a7e-4223-ba56-479f69254841 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1339 microversion: 2.20 time: 0.194885 Nov 24 03:04:22.951256 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 33/60] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:04:22 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1339 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:04:22.980592 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-d3effb54-ac42-47c4-aca6-e8e870e62c78 req-c77954ed-13a1-4a9d-988b-bd20947dacc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfde9ed7-de6c-421b-bb42-46506b2ef81d", "tag": "e1dd953c-f2a6-4135-a4b0-00a1cb515b08"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:22.982932 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:04:22.982932 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:04:22.996401 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-d3effb54-ac42-47c4-aca6-e8e870e62c78 req-c77954ed-13a1-4a9d-988b-bd20947dacc2 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:22.998050 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-d3effb54-ac42-47c4-aca6-e8e870e62c78 req-c77954ed-13a1-4a9d-988b-bd20947dacc2 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:23.026335 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-d3effb54-ac42-47c4-aca6-e8e870e62c78 req-c77954ed-13a1-4a9d-988b-bd20947dacc2 service nova] Creating event network-changed:e1dd953c-f2a6-4135-a4b0-00a1cb515b08 for instance bfde9ed7-de6c-421b-bb42-46506b2ef81d on hv-cinder-81803 Nov 24 03:04:23.033375 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-d3effb54-ac42-47c4-aca6-e8e870e62c78 req-c77954ed-13a1-4a9d-988b-bd20947dacc2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058247 Nov 24 03:04:23.037655 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 34/61] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:04:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:04:23.043444 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7c835464-fcdd-4aed-b9db-e54df4761a0e tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:23.053542 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-7c835464-fcdd-4aed-b9db-e54df4761a0e tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:23.074841 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7c835464-fcdd-4aed-b9db-e54df4761a0e tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:23.075396 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7c835464-fcdd-4aed-b9db-e54df4761a0e tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:23.076311 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7c835464-fcdd-4aed-b9db-e54df4761a0e tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:23.076830 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7c835464-fcdd-4aed-b9db-e54df4761a0e tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:23.400131 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-36e7feab-40b1-47c2-aeba-5c370dab811d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:23.433191 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-36e7feab-40b1-47c2-aeba-5c370dab811d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1317 microversion: 2.1 time: 0.955476 Nov 24 03:04:23.440015 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 28/62] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:22 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1317 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:23.533219 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3fcdf4f6-75ba-4473-ae72-cb121d4e3764 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:23.537634 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3fcdf4f6-75ba-4473-ae72-cb121d4e3764 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:23.553658 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7c835464-fcdd-4aed-b9db-e54df4761a0e tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:23.561885 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3fcdf4f6-75ba-4473-ae72-cb121d4e3764 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:23.568023 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3fcdf4f6-75ba-4473-ae72-cb121d4e3764 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:23.571916 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3fcdf4f6-75ba-4473-ae72-cb121d4e3764 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:23.577370 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3fcdf4f6-75ba-4473-ae72-cb121d4e3764 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:23.592919 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7c835464-fcdd-4aed-b9db-e54df4761a0e tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1315 microversion: 2.1 time: 0.546579 Nov 24 03:04:23.594047 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 35/63] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:23 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:23.925555 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-05a4b3af-f06f-48f5-83c3-8a331681bfd5 req-4a9c5528-7a93-42de-ad2e-947822297e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a175fec-cd0a-49a4-a612-b3698836edef", "name": "network-vif-plugged", "status": "completed", "tag": "2d767caa-bca8-41a0-b79c-dbef07431926"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:23.932457 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:04:23.932457 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:04:23.973169 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-05a4b3af-f06f-48f5-83c3-8a331681bfd5 req-4a9c5528-7a93-42de-ad2e-947822297e3f service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:23.980247 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-05a4b3af-f06f-48f5-83c3-8a331681bfd5 req-4a9c5528-7a93-42de-ad2e-947822297e3f service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:24.062106 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-05a4b3af-f06f-48f5-83c3-8a331681bfd5 req-4a9c5528-7a93-42de-ad2e-947822297e3f service nova] Creating event network-vif-plugged:2d767caa-bca8-41a0-b79c-dbef07431926 for instance 9a175fec-cd0a-49a4-a612-b3698836edef on hv-cinder-81803 Nov 24 03:04:24.076842 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-05a4b3af-f06f-48f5-83c3-8a331681bfd5 req-4a9c5528-7a93-42de-ad2e-947822297e3f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.318676 Nov 24 03:04:24.090945 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 36/64] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:04:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:04:24.120648 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-1c25d69c-dfbf-46d3-9588-996dab300e4a req-41d2f4d5-c210-4c75-bcf6-0ab84804b4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bd67a95-85a5-4669-bc7b-2d50f1716c54", "tag": "20bfed33-5015-44fe-bee7-37407d6d4c9e"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:24.130722 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:04:24.130722 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:04:24.165699 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-1c25d69c-dfbf-46d3-9588-996dab300e4a req-41d2f4d5-c210-4c75-bcf6-0ab84804b4d7 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:24.166994 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-1c25d69c-dfbf-46d3-9588-996dab300e4a req-41d2f4d5-c210-4c75-bcf6-0ab84804b4d7 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:24.203824 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-1c25d69c-dfbf-46d3-9588-996dab300e4a req-41d2f4d5-c210-4c75-bcf6-0ab84804b4d7 service nova] Creating event network-changed:20bfed33-5015-44fe-bee7-37407d6d4c9e for instance 6bd67a95-85a5-4669-bc7b-2d50f1716c54 on hv-cinder-81803 Nov 24 03:04:24.225953 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-1c25d69c-dfbf-46d3-9588-996dab300e4a req-41d2f4d5-c210-4c75-bcf6-0ab84804b4d7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127223 Nov 24 03:04:24.229482 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 37/65] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:04:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:04:24.265940 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-9c8dd101-615e-422f-966e-4f72bbe6f82d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:24.267941 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-9c8dd101-615e-422f-966e-4f72bbe6f82d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:24.281100 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9c8dd101-615e-422f-966e-4f72bbe6f82d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:24.282755 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9c8dd101-615e-422f-966e-4f72bbe6f82d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:24.285535 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9c8dd101-615e-422f-966e-4f72bbe6f82d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:24.286959 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9c8dd101-615e-422f-966e-4f72bbe6f82d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:24.585810 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-9c8dd101-615e-422f-966e-4f72bbe6f82d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:24.613259 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-9c8dd101-615e-422f-966e-4f72bbe6f82d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:24.627653 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-9c8dd101-615e-422f-966e-4f72bbe6f82d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:24.629939 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-9c8dd101-615e-422f-966e-4f72bbe6f82d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1339 microversion: 2.20 time: 0.396763 Nov 24 03:04:24.631112 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 38/66] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:04:24 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1339 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:04:24.665041 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-90366fa4-e9b2-4b4b-854d-fa28c3e3b44e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:24.667013 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-90366fa4-e9b2-4b4b-854d-fa28c3e3b44e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:24.687685 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-90366fa4-e9b2-4b4b-854d-fa28c3e3b44e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:24.689125 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-90366fa4-e9b2-4b4b-854d-fa28c3e3b44e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:24.693570 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-90366fa4-e9b2-4b4b-854d-fa28c3e3b44e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:24.696077 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-90366fa4-e9b2-4b4b-854d-fa28c3e3b44e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:24.802547 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3fcdf4f6-75ba-4473-ae72-cb121d4e3764 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:24.836472 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3fcdf4f6-75ba-4473-ae72-cb121d4e3764 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1321 microversion: 2.1 time: 1.314711 Nov 24 03:04:24.842427 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 29/67] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:23 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1321 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:24.868838 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bcc4d392-56da-417b-975b-e7a7925173b7 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:24.869884 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bcc4d392-56da-417b-975b-e7a7925173b7 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:24.898241 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bcc4d392-56da-417b-975b-e7a7925173b7 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:24.899726 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bcc4d392-56da-417b-975b-e7a7925173b7 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:24.901627 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bcc4d392-56da-417b-975b-e7a7925173b7 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:24.902394 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bcc4d392-56da-417b-975b-e7a7925173b7 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:25.157471 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-90366fa4-e9b2-4b4b-854d-fa28c3e3b44e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:25.167201 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-90366fa4-e9b2-4b4b-854d-fa28c3e3b44e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1317 microversion: 2.1 time: 0.516193 Nov 24 03:04:25.167806 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 39/68] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:24 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:25.377486 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-bcc4d392-56da-417b-975b-e7a7925173b7 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:25.418557 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bcc4d392-56da-417b-975b-e7a7925173b7 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1315 microversion: 2.1 time: 0.574316 Nov 24 03:04:25.433012 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 30/69] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:24 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:25.662364 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-56d6e56b-e9ff-4aa4-b9e4-c44f702f9408 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:25.663824 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-56d6e56b-e9ff-4aa4-b9e4-c44f702f9408 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:25.675269 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-56d6e56b-e9ff-4aa4-b9e4-c44f702f9408 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:25.676440 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-56d6e56b-e9ff-4aa4-b9e4-c44f702f9408 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:25.678422 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-56d6e56b-e9ff-4aa4-b9e4-c44f702f9408 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:25.679476 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-56d6e56b-e9ff-4aa4-b9e4-c44f702f9408 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:25.870687 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-eff8002f-2dfb-4369-b016-ddeca6eef9f6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:25.877065 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-eff8002f-2dfb-4369-b016-ddeca6eef9f6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:25.913619 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eff8002f-2dfb-4369-b016-ddeca6eef9f6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:25.916151 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eff8002f-2dfb-4369-b016-ddeca6eef9f6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:25.918808 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eff8002f-2dfb-4369-b016-ddeca6eef9f6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:25.919995 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eff8002f-2dfb-4369-b016-ddeca6eef9f6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:26.066287 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-56d6e56b-e9ff-4aa4-b9e4-c44f702f9408 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:26.076996 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-56d6e56b-e9ff-4aa4-b9e4-c44f702f9408 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:26.079578 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-56d6e56b-e9ff-4aa4-b9e4-c44f702f9408 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:26.081170 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-56d6e56b-e9ff-4aa4-b9e4-c44f702f9408 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1407 microversion: 2.20 time: 0.426490 Nov 24 03:04:26.093293 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 40/70] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:04:25 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1407 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:04:26.131656 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-d60b6da2-2998-4c7c-b01c-29874af1750e req-9b884201-6b01-4d7f-8684-0a59961f56cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7336735a-138d-4072-a48b-30b6741211cb", "name": "network-vif-plugged", "status": "completed", "tag": "2c9cdbfc-f976-4a05-b58d-e0d5a3660703"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:26.134813 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:04:26.134813 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:04:26.151698 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-d60b6da2-2998-4c7c-b01c-29874af1750e req-9b884201-6b01-4d7f-8684-0a59961f56cd service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:26.152757 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-d60b6da2-2998-4c7c-b01c-29874af1750e req-9b884201-6b01-4d7f-8684-0a59961f56cd service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:26.175862 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-d60b6da2-2998-4c7c-b01c-29874af1750e req-9b884201-6b01-4d7f-8684-0a59961f56cd service nova] Creating event network-vif-plugged:2c9cdbfc-f976-4a05-b58d-e0d5a3660703 for instance 7336735a-138d-4072-a48b-30b6741211cb on hv-cinder-81803 Nov 24 03:04:26.185744 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-d60b6da2-2998-4c7c-b01c-29874af1750e req-9b884201-6b01-4d7f-8684-0a59961f56cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061026 Nov 24 03:04:26.187836 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 41/71] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:04:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:04:26.199274 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-04df28b8-e965-4379-96c6-6bff17770e9d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:26.200244 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-04df28b8-e965-4379-96c6-6bff17770e9d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:26.209070 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-04df28b8-e965-4379-96c6-6bff17770e9d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:26.209798 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-04df28b8-e965-4379-96c6-6bff17770e9d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:26.211415 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-04df28b8-e965-4379-96c6-6bff17770e9d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:26.212679 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-04df28b8-e965-4379-96c6-6bff17770e9d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:26.336483 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-eff8002f-2dfb-4369-b016-ddeca6eef9f6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:26.349552 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-eff8002f-2dfb-4369-b016-ddeca6eef9f6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1321 microversion: 2.1 time: 0.487955 Nov 24 03:04:26.351356 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 31/72] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:25 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1321 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:26.464326 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-124130b0-e533-4843-83b6-919e1d16f655 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:26.465708 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-124130b0-e533-4843-83b6-919e1d16f655 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:26.489696 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-124130b0-e533-4843-83b6-919e1d16f655 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:26.492180 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-124130b0-e533-4843-83b6-919e1d16f655 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:26.493047 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-124130b0-e533-4843-83b6-919e1d16f655 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:26.494291 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-124130b0-e533-4843-83b6-919e1d16f655 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:26.530648 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-04df28b8-e965-4379-96c6-6bff17770e9d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:26.559118 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-04df28b8-e965-4379-96c6-6bff17770e9d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1317 microversion: 2.1 time: 0.368901 Nov 24 03:04:26.563220 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 42/73] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:26 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:26.817435 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-124130b0-e533-4843-83b6-919e1d16f655 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:26.827999 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-124130b0-e533-4843-83b6-919e1d16f655 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1315 microversion: 2.1 time: 0.374610 Nov 24 03:04:26.828997 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 32/74] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:26 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:27.104325 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f8cfa5a6-6682-4707-a6b4-1f573e7072a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:27.105356 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f8cfa5a6-6682-4707-a6b4-1f573e7072a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:27.115825 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f8cfa5a6-6682-4707-a6b4-1f573e7072a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:27.116530 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f8cfa5a6-6682-4707-a6b4-1f573e7072a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:27.117998 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f8cfa5a6-6682-4707-a6b4-1f573e7072a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:27.118705 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f8cfa5a6-6682-4707-a6b4-1f573e7072a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:27.381330 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-24168649-4926-4cec-87c4-8e2f46ac9137 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:27.382623 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-24168649-4926-4cec-87c4-8e2f46ac9137 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:27.392725 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-24168649-4926-4cec-87c4-8e2f46ac9137 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:27.394853 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-24168649-4926-4cec-87c4-8e2f46ac9137 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:27.396311 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-24168649-4926-4cec-87c4-8e2f46ac9137 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:27.397037 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-24168649-4926-4cec-87c4-8e2f46ac9137 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:27.407697 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f8cfa5a6-6682-4707-a6b4-1f573e7072a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:27.423594 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f8cfa5a6-6682-4707-a6b4-1f573e7072a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:27.439519 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f8cfa5a6-6682-4707-a6b4-1f573e7072a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:27.445641 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f8cfa5a6-6682-4707-a6b4-1f573e7072a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1407 microversion: 2.20 time: 0.347587 Nov 24 03:04:27.446729 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 43/75] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:04:27 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1407 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:04:27.591774 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f83b9033-419b-4222-b988-2c9f00d70afb tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:27.592735 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f83b9033-419b-4222-b988-2c9f00d70afb tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:27.604553 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f83b9033-419b-4222-b988-2c9f00d70afb tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:27.605362 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f83b9033-419b-4222-b988-2c9f00d70afb tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:27.606897 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f83b9033-419b-4222-b988-2c9f00d70afb tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:27.607664 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f83b9033-419b-4222-b988-2c9f00d70afb tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:27.665716 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-24168649-4926-4cec-87c4-8e2f46ac9137 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:27.690428 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-24168649-4926-4cec-87c4-8e2f46ac9137 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1321 microversion: 2.1 time: 0.315392 Nov 24 03:04:27.702657 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 33/76] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:27 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:27.848927 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f83b9033-419b-4222-b988-2c9f00d70afb tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:27.850796 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-072eb080-71d7-4e32-b279-229edbcffc3a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:27.852428 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-072eb080-71d7-4e32-b279-229edbcffc3a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:27.864801 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f83b9033-419b-4222-b988-2c9f00d70afb tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1317 microversion: 2.1 time: 0.279461 Nov 24 03:04:27.868481 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 44/77] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:27 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:27.870902 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-072eb080-71d7-4e32-b279-229edbcffc3a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:27.872108 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-072eb080-71d7-4e32-b279-229edbcffc3a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:27.878409 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-072eb080-71d7-4e32-b279-229edbcffc3a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:27.879542 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-072eb080-71d7-4e32-b279-229edbcffc3a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:28.331801 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-072eb080-71d7-4e32-b279-229edbcffc3a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:28.354799 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-072eb080-71d7-4e32-b279-229edbcffc3a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1315 microversion: 2.1 time: 0.512223 Nov 24 03:04:28.370469 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 34/78] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:27 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1315 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:28.486245 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-668dcfd9-9c48-416e-a51c-fb61dbd44128 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:28.490251 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-668dcfd9-9c48-416e-a51c-fb61dbd44128 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:28.513157 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-668dcfd9-9c48-416e-a51c-fb61dbd44128 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:28.515722 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-668dcfd9-9c48-416e-a51c-fb61dbd44128 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:28.517492 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-668dcfd9-9c48-416e-a51c-fb61dbd44128 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:28.518601 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-668dcfd9-9c48-416e-a51c-fb61dbd44128 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:28.718582 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c66ef8d9-2f6c-4fa7-8362-fe8b47541e4e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:28.719852 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c66ef8d9-2f6c-4fa7-8362-fe8b47541e4e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:28.731298 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c66ef8d9-2f6c-4fa7-8362-fe8b47541e4e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:28.732075 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c66ef8d9-2f6c-4fa7-8362-fe8b47541e4e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:28.734304 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c66ef8d9-2f6c-4fa7-8362-fe8b47541e4e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:28.735543 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c66ef8d9-2f6c-4fa7-8362-fe8b47541e4e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:28.978182 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-668dcfd9-9c48-416e-a51c-fb61dbd44128 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:28.988307 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-668dcfd9-9c48-416e-a51c-fb61dbd44128 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:28.995650 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-668dcfd9-9c48-416e-a51c-fb61dbd44128 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:29.001464 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-668dcfd9-9c48-416e-a51c-fb61dbd44128 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1407 microversion: 2.20 time: 0.529922 Nov 24 03:04:29.002670 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 45/79] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:04:28 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1407 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:04:29.022976 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4d86c9be-9ae2-4d76-8059-be8f42594d39 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:29.028112 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4d86c9be-9ae2-4d76-8059-be8f42594d39 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:29.035735 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4d86c9be-9ae2-4d76-8059-be8f42594d39 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:29.036443 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4d86c9be-9ae2-4d76-8059-be8f42594d39 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:29.037413 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4d86c9be-9ae2-4d76-8059-be8f42594d39 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:29.038033 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4d86c9be-9ae2-4d76-8059-be8f42594d39 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:29.396179 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4d86c9be-9ae2-4d76-8059-be8f42594d39 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:29.410585 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4d86c9be-9ae2-4d76-8059-be8f42594d39 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1317 microversion: 2.1 time: 0.393677 Nov 24 03:04:29.422537 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 46/80] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:29 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:29.434980 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5e8bd822-10eb-4800-a783-1bca659086cf tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:29.435866 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-5e8bd822-10eb-4800-a783-1bca659086cf tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:29.446350 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5e8bd822-10eb-4800-a783-1bca659086cf tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:29.447040 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5e8bd822-10eb-4800-a783-1bca659086cf tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:29.448344 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5e8bd822-10eb-4800-a783-1bca659086cf tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:29.449015 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5e8bd822-10eb-4800-a783-1bca659086cf tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:29.675910 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c66ef8d9-2f6c-4fa7-8362-fe8b47541e4e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:29.686188 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c66ef8d9-2f6c-4fa7-8362-fe8b47541e4e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1321 microversion: 2.1 time: 0.972158 Nov 24 03:04:29.691600 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 35/81] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:28 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1321 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:29.800821 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5e8bd822-10eb-4800-a783-1bca659086cf tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:29.816301 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-5e8bd822-10eb-4800-a783-1bca659086cf tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1315 microversion: 2.1 time: 0.391443 Nov 24 03:04:29.817252 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 47/82] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:29 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:30.024379 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b9f1370c-5fc5-42dd-868c-68162f7b6097 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:30.025179 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b9f1370c-5fc5-42dd-868c-68162f7b6097 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:30.064892 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b9f1370c-5fc5-42dd-868c-68162f7b6097 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:30.065720 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b9f1370c-5fc5-42dd-868c-68162f7b6097 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:30.069581 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b9f1370c-5fc5-42dd-868c-68162f7b6097 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:30.071518 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b9f1370c-5fc5-42dd-868c-68162f7b6097 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:30.438296 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-9fb63aa3-57fa-470a-85a9-de6ece8542d2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:30.439436 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-9fb63aa3-57fa-470a-85a9-de6ece8542d2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:30.483555 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9fb63aa3-57fa-470a-85a9-de6ece8542d2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:30.484666 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9fb63aa3-57fa-470a-85a9-de6ece8542d2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:30.486787 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9fb63aa3-57fa-470a-85a9-de6ece8542d2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:30.487567 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9fb63aa3-57fa-470a-85a9-de6ece8542d2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:30.859116 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-9fb63aa3-57fa-470a-85a9-de6ece8542d2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:30.872221 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-9fb63aa3-57fa-470a-85a9-de6ece8542d2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1508 microversion: 2.1 time: 0.438328 Nov 24 03:04:30.873486 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 48/83] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:30 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1508 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:30.897219 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b2dbb95b-5581-499b-9279-9d96e143d838 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:30.903219 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b2dbb95b-5581-499b-9279-9d96e143d838 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:30.903534 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b9f1370c-5fc5-42dd-868c-68162f7b6097 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:30.920023 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b2dbb95b-5581-499b-9279-9d96e143d838 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:30.920523 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b2dbb95b-5581-499b-9279-9d96e143d838 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:30.921404 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b2dbb95b-5581-499b-9279-9d96e143d838 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:30.921883 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b2dbb95b-5581-499b-9279-9d96e143d838 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:30.923201 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b9f1370c-5fc5-42dd-868c-68162f7b6097 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:30.927806 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b9f1370c-5fc5-42dd-868c-68162f7b6097 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:30.933472 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b9f1370c-5fc5-42dd-868c-68162f7b6097 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1407 microversion: 2.20 time: 0.911856 Nov 24 03:04:30.935577 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 36/84] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:04:30 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1407 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:04:30.955274 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a68af705-15c2-4c52-ac39-a7b30961d906 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:30.958791 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a68af705-15c2-4c52-ac39-a7b30961d906 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:30.986343 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a68af705-15c2-4c52-ac39-a7b30961d906 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:30.987611 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a68af705-15c2-4c52-ac39-a7b30961d906 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:30.993258 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a68af705-15c2-4c52-ac39-a7b30961d906 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:30.994434 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a68af705-15c2-4c52-ac39-a7b30961d906 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:31.308483 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b2dbb95b-5581-499b-9279-9d96e143d838 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:31.319537 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b2dbb95b-5581-499b-9279-9d96e143d838 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1321 microversion: 2.1 time: 0.443211 Nov 24 03:04:31.320888 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 49/85] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:30 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1321 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:31.705501 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-0e25232e-3b7b-4a69-adec-e9dbddf27e1d req-6c08d235-3d18-43a8-95d7-e59b1b4b9794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfaf6d4e-4188-451d-8af8-32300d13ae2d", "tag": "521a966d-715d-42d8-a2e3-077f7788aac2"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:31.707885 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:04:31.707885 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:04:31.728690 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-0e25232e-3b7b-4a69-adec-e9dbddf27e1d req-6c08d235-3d18-43a8-95d7-e59b1b4b9794 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:31.729154 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-0e25232e-3b7b-4a69-adec-e9dbddf27e1d req-6c08d235-3d18-43a8-95d7-e59b1b4b9794 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:31.754790 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-0e25232e-3b7b-4a69-adec-e9dbddf27e1d req-6c08d235-3d18-43a8-95d7-e59b1b4b9794 service nova] Creating event network-changed:521a966d-715d-42d8-a2e3-077f7788aac2 for instance dfaf6d4e-4188-451d-8af8-32300d13ae2d on hv-cinder-81803 Nov 24 03:04:31.763513 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-0e25232e-3b7b-4a69-adec-e9dbddf27e1d req-6c08d235-3d18-43a8-95d7-e59b1b4b9794 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062258 Nov 24 03:04:31.765210 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 50/86] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:04:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:04:31.832353 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a68af705-15c2-4c52-ac39-a7b30961d906 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:31.855311 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a68af705-15c2-4c52-ac39-a7b30961d906 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1501 microversion: 2.1 time: 0.917171 Nov 24 03:04:31.855956 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 37/87] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:30 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1501 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:31.956393 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-6ccc1fff-b95b-480d-856d-a0f6dd0daa0d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:31.957311 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-6ccc1fff-b95b-480d-856d-a0f6dd0daa0d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:31.977871 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6ccc1fff-b95b-480d-856d-a0f6dd0daa0d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:31.978799 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6ccc1fff-b95b-480d-856d-a0f6dd0daa0d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:31.990574 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6ccc1fff-b95b-480d-856d-a0f6dd0daa0d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:31.991337 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6ccc1fff-b95b-480d-856d-a0f6dd0daa0d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:32.410168 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-df8c548d-6588-43e1-bc20-38874dd6a821 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:32.411190 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-df8c548d-6588-43e1-bc20-38874dd6a821 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:32.457900 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df8c548d-6588-43e1-bc20-38874dd6a821 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:32.458957 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df8c548d-6588-43e1-bc20-38874dd6a821 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:32.460387 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df8c548d-6588-43e1-bc20-38874dd6a821 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:32.470014 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df8c548d-6588-43e1-bc20-38874dd6a821 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:32.569126 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-6ccc1fff-b95b-480d-856d-a0f6dd0daa0d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:32.604128 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-6ccc1fff-b95b-480d-856d-a0f6dd0daa0d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:32.610644 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-6ccc1fff-b95b-480d-856d-a0f6dd0daa0d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:32.614843 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-6ccc1fff-b95b-480d-856d-a0f6dd0daa0d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1407 microversion: 2.20 time: 0.661570 Nov 24 03:04:32.616929 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 51/88] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:04:31 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1407 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:04:33.078286 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-df493eb5-df67-4ae2-bec3-eb4f12513178 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de29442d-c3cc-4d80-b917-00bdd663868a"}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:33.079519 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-df493eb5-df67-4ae2-bec3-eb4f12513178 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:33.096053 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-df8c548d-6588-43e1-bc20-38874dd6a821 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:33.138547 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-df493eb5-df67-4ae2-bec3-eb4f12513178 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:33.142668 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-df8c548d-6588-43e1-bc20-38874dd6a821 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1321 microversion: 2.1 time: 0.739978 Nov 24 03:04:33.144600 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-df493eb5-df67-4ae2-bec3-eb4f12513178 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:33.160372 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-df493eb5-df67-4ae2-bec3-eb4f12513178 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:33.161066 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 38/89] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:32 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1321 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:33.167356 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-df493eb5-df67-4ae2-bec3-eb4f12513178 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:33.198116 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-a3d65728-740e-4109-963b-4bc321a7465a req-9a61c0af-58ad-4f06-8fc5-84c2449ac923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfde9ed7-de6c-421b-bb42-46506b2ef81d", "name": "network-vif-plugged", "status": "completed", "tag": "e1dd953c-f2a6-4135-a4b0-00a1cb515b08"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:33.207986 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:04:33.207986 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:04:33.243190 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-a3d65728-740e-4109-963b-4bc321a7465a req-9a61c0af-58ad-4f06-8fc5-84c2449ac923 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:33.247757 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-a3d65728-740e-4109-963b-4bc321a7465a req-9a61c0af-58ad-4f06-8fc5-84c2449ac923 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:33.328152 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-a3d65728-740e-4109-963b-4bc321a7465a req-9a61c0af-58ad-4f06-8fc5-84c2449ac923 service nova] Creating event network-vif-plugged:e1dd953c-f2a6-4135-a4b0-00a1cb515b08 for instance bfde9ed7-de6c-421b-bb42-46506b2ef81d on hv-cinder-81803 Nov 24 03:04:33.329329 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-a3d65728-740e-4109-963b-4bc321a7465a req-9a61c0af-58ad-4f06-8fc5-84c2449ac923 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116330) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 24 03:04:33.334435 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2e69e27c-d074-4dde-95a6-046522ffd4b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:33.348576 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2e69e27c-d074-4dde-95a6-046522ffd4b8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:33.350555 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2e69e27c-d074-4dde-95a6-046522ffd4b8 None None] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:33.351553 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2e69e27c-d074-4dde-95a6-046522ffd4b8 None None] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:33.401594 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.compute.rpcapi [None req-2e69e27c-d074-4dde-95a6-046522ffd4b8 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 24 03:04:33.410317 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2e69e27c-d074-4dde-95a6-046522ffd4b8 None None] Releasing lock "compute-rpcapi-router" {{(pid=116330) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 24 03:04:33.496021 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2e69e27c-d074-4dde-95a6-046522ffd4b8 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.303324 Nov 24 03:04:33.496403 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 39/90] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:04:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:04:33.646990 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-77001182-5aa3-47d1-b693-103da2b507eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:33.647751 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-77001182-5aa3-47d1-b693-103da2b507eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:33.664751 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77001182-5aa3-47d1-b693-103da2b507eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:33.671819 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77001182-5aa3-47d1-b693-103da2b507eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:33.673254 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77001182-5aa3-47d1-b693-103da2b507eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:33.673696 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77001182-5aa3-47d1-b693-103da2b507eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:33.988848 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-df493eb5-df67-4ae2-bec3-eb4f12513178 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "POST /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.920318 Nov 24 03:04:33.995659 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 52/91] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Nov 24 03:04:33 2021] POST /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef/os-volume_attachments => generated 194 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:04:34.036547 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0f5e688b-8c8b-41bf-8bf6-e77ff989be59 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba4b4746-7240-432e-afd9-f9c7eb46cc38"}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:34.037829 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0f5e688b-8c8b-41bf-8bf6-e77ff989be59 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:34.049120 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0f5e688b-8c8b-41bf-8bf6-e77ff989be59 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:34.050248 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0f5e688b-8c8b-41bf-8bf6-e77ff989be59 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:34.051238 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0f5e688b-8c8b-41bf-8bf6-e77ff989be59 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:34.051728 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0f5e688b-8c8b-41bf-8bf6-e77ff989be59 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:34.501482 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-77001182-5aa3-47d1-b693-103da2b507eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:34.517232 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-77001182-5aa3-47d1-b693-103da2b507eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:34.520132 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-77001182-5aa3-47d1-b693-103da2b507eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:34.523077 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-77001182-5aa3-47d1-b693-103da2b507eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1407 microversion: 2.20 time: 0.882591 Nov 24 03:04:34.525379 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 40/92] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:04:33 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1407 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:04:34.530572 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-661d1209-514c-4b80-9a6c-ae468604b197 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:34.533626 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-661d1209-514c-4b80-9a6c-ae468604b197 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:34.546172 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-661d1209-514c-4b80-9a6c-ae468604b197 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:34.546708 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-661d1209-514c-4b80-9a6c-ae468604b197 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:34.547598 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-661d1209-514c-4b80-9a6c-ae468604b197 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:34.548111 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-661d1209-514c-4b80-9a6c-ae468604b197 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:34.709627 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0f5e688b-8c8b-41bf-8bf6-e77ff989be59 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "POST /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.677485 Nov 24 03:04:34.712220 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 53/93] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Nov 24 03:04:34 2021] POST /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb/os-volume_attachments => generated 194 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:04:34.818579 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-661d1209-514c-4b80-9a6c-ae468604b197 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:34.831170 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-661d1209-514c-4b80-9a6c-ae468604b197 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1321 microversion: 2.1 time: 0.304023 Nov 24 03:04:34.845955 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 41/94] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:34 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:35.567003 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ec45d8c3-3220-4c13-99cb-8941dbcda00e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:35.567979 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ec45d8c3-3220-4c13-99cb-8941dbcda00e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:35.576984 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ec45d8c3-3220-4c13-99cb-8941dbcda00e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:35.577532 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ec45d8c3-3220-4c13-99cb-8941dbcda00e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:35.578463 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ec45d8c3-3220-4c13-99cb-8941dbcda00e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:35.579151 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ec45d8c3-3220-4c13-99cb-8941dbcda00e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:35.860984 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4a825cdf-bad2-44e1-ba13-934f14d3c70b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:35.863756 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4a825cdf-bad2-44e1-ba13-934f14d3c70b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:35.875831 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4a825cdf-bad2-44e1-ba13-934f14d3c70b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:35.878517 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4a825cdf-bad2-44e1-ba13-934f14d3c70b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:35.880588 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4a825cdf-bad2-44e1-ba13-934f14d3c70b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:35.881839 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4a825cdf-bad2-44e1-ba13-934f14d3c70b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:36.013071 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ec45d8c3-3220-4c13-99cb-8941dbcda00e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:36.048982 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ec45d8c3-3220-4c13-99cb-8941dbcda00e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:36.057052 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ec45d8c3-3220-4c13-99cb-8941dbcda00e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:36.065382 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ec45d8c3-3220-4c13-99cb-8941dbcda00e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1407 microversion: 2.20 time: 0.509091 Nov 24 03:04:36.070521 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 54/95] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:04:35 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1407 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:04:36.818803 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-8e0c70a1-acdd-46ea-9190-09c748036192 req-704c5d34-a215-4b08-9f56-13002b64960d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd67a95-85a5-4669-bc7b-2d50f1716c54", "name": "network-vif-plugged", "status": "completed", "tag": "20bfed33-5015-44fe-bee7-37407d6d4c9e"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:36.821509 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:04:36.821509 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:04:36.838454 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4a825cdf-bad2-44e1-ba13-934f14d3c70b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:36.851507 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-8e0c70a1-acdd-46ea-9190-09c748036192 req-704c5d34-a215-4b08-9f56-13002b64960d service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:36.853710 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-8e0c70a1-acdd-46ea-9190-09c748036192 req-704c5d34-a215-4b08-9f56-13002b64960d service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:36.862141 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4a825cdf-bad2-44e1-ba13-934f14d3c70b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1516 microversion: 2.1 time: 1.007002 Nov 24 03:04:36.863631 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 42/96] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:35 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1516 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:36.894145 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-8e0c70a1-acdd-46ea-9190-09c748036192 req-704c5d34-a215-4b08-9f56-13002b64960d service nova] Creating event network-vif-plugged:20bfed33-5015-44fe-bee7-37407d6d4c9e for instance 6bd67a95-85a5-4669-bc7b-2d50f1716c54 on hv-cinder-81803 Nov 24 03:04:36.901291 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5cb9e46b-3a32-4b8b-9a9f-d545f958bea3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:36.906215 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5cb9e46b-3a32-4b8b-9a9f-d545f958bea3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:36.906476 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-8e0c70a1-acdd-46ea-9190-09c748036192 req-704c5d34-a215-4b08-9f56-13002b64960d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092441 Nov 24 03:04:36.907898 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 55/97] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:04:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:04:36.941049 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5cb9e46b-3a32-4b8b-9a9f-d545f958bea3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:36.956194 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5cb9e46b-3a32-4b8b-9a9f-d545f958bea3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:36.960093 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5cb9e46b-3a32-4b8b-9a9f-d545f958bea3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:36.963913 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5cb9e46b-3a32-4b8b-9a9f-d545f958bea3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:37.110691 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f4f0b6c8-1000-49fe-ace5-daf7747af0b6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:37.112303 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f4f0b6c8-1000-49fe-ace5-daf7747af0b6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:37.138180 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f4f0b6c8-1000-49fe-ace5-daf7747af0b6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:37.139130 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f4f0b6c8-1000-49fe-ace5-daf7747af0b6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:37.144610 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f4f0b6c8-1000-49fe-ace5-daf7747af0b6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:37.148536 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f4f0b6c8-1000-49fe-ace5-daf7747af0b6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:37.265465 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-5cb9e46b-3a32-4b8b-9a9f-d545f958bea3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lazy-loading 'flavor' on Instance uuid bfde9ed7-de6c-421b-bb42-46506b2ef81d {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:04:37.610713 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5cb9e46b-3a32-4b8b-9a9f-d545f958bea3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "POST /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d/action" status: 200 len: 32 microversion: 2.1 time: 0.718807 Nov 24 03:04:37.612109 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 43/98] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:04:36 2021] POST /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d/action => generated 32 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:04:37.628450 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-53e9d4cf-7c46-4035-bd90-8c67fb9533ad tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:37.631066 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-53e9d4cf-7c46-4035-bd90-8c67fb9533ad tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:37.647128 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-53e9d4cf-7c46-4035-bd90-8c67fb9533ad tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:37.649024 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-53e9d4cf-7c46-4035-bd90-8c67fb9533ad tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:37.652021 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-53e9d4cf-7c46-4035-bd90-8c67fb9533ad tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:37.653079 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-53e9d4cf-7c46-4035-bd90-8c67fb9533ad tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:37.936256 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f4f0b6c8-1000-49fe-ace5-daf7747af0b6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:37.966219 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f4f0b6c8-1000-49fe-ace5-daf7747af0b6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:37.969809 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f4f0b6c8-1000-49fe-ace5-daf7747af0b6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:37.973850 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f4f0b6c8-1000-49fe-ace5-daf7747af0b6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1407 microversion: 2.20 time: 0.872727 Nov 24 03:04:37.975631 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 56/99] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:04:37 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1407 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:04:38.342817 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-53e9d4cf-7c46-4035-bd90-8c67fb9533ad tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:38.366425 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-53e9d4cf-7c46-4035-bd90-8c67fb9533ad tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.746465 Nov 24 03:04:38.378220 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 44/100] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:37 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:39.002544 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-3c7cd3fb-0114-42aa-a146-d9b4b1279ca5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:39.004736 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-3c7cd3fb-0114-42aa-a146-d9b4b1279ca5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:39.035910 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3c7cd3fb-0114-42aa-a146-d9b4b1279ca5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:39.038932 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3c7cd3fb-0114-42aa-a146-d9b4b1279ca5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:39.045465 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3c7cd3fb-0114-42aa-a146-d9b4b1279ca5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:39.046421 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3c7cd3fb-0114-42aa-a146-d9b4b1279ca5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:39.321689 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-3c7cd3fb-0114-42aa-a146-d9b4b1279ca5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:39.341889 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-3c7cd3fb-0114-42aa-a146-d9b4b1279ca5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:39.346944 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-3c7cd3fb-0114-42aa-a146-d9b4b1279ca5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:39.349892 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-3c7cd3fb-0114-42aa-a146-d9b4b1279ca5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1407 microversion: 2.20 time: 0.356392 Nov 24 03:04:39.352730 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 57/101] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:04:38 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1407 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:04:39.406056 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-dafb0fa4-0f04-42c3-b23b-62d595e5e1da tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:39.407463 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-dafb0fa4-0f04-42c3-b23b-62d595e5e1da tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:39.415627 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dafb0fa4-0f04-42c3-b23b-62d595e5e1da tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:39.416554 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dafb0fa4-0f04-42c3-b23b-62d595e5e1da tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:39.417613 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dafb0fa4-0f04-42c3-b23b-62d595e5e1da tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:39.418497 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dafb0fa4-0f04-42c3-b23b-62d595e5e1da tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:39.625978 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-dafb0fa4-0f04-42c3-b23b-62d595e5e1da tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:39.645793 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-dafb0fa4-0f04-42c3-b23b-62d595e5e1da tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.243170 Nov 24 03:04:39.647465 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 45/102] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:39 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:40.220334 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-420682ce-bf67-4b49-8b2f-69ae7ee5f15a req-1866cb0f-04b1-417b-844d-a93e63aa8d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfaf6d4e-4188-451d-8af8-32300d13ae2d", "name": "network-vif-plugged", "status": "completed", "tag": "521a966d-715d-42d8-a2e3-077f7788aac2"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:40.224941 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:04:40.224941 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:04:40.248649 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-420682ce-bf67-4b49-8b2f-69ae7ee5f15a req-1866cb0f-04b1-417b-844d-a93e63aa8d6c service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:40.249392 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-420682ce-bf67-4b49-8b2f-69ae7ee5f15a req-1866cb0f-04b1-417b-844d-a93e63aa8d6c service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:40.271997 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-420682ce-bf67-4b49-8b2f-69ae7ee5f15a req-1866cb0f-04b1-417b-844d-a93e63aa8d6c service nova] Creating event network-vif-plugged:521a966d-715d-42d8-a2e3-077f7788aac2 for instance dfaf6d4e-4188-451d-8af8-32300d13ae2d on hv-cinder-81803 Nov 24 03:04:40.281294 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-420682ce-bf67-4b49-8b2f-69ae7ee5f15a req-1866cb0f-04b1-417b-844d-a93e63aa8d6c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069348 Nov 24 03:04:40.283650 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 58/103] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:04:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:04:40.375663 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d091688e-3187-4793-a805-64ab0e1feef3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:40.376608 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d091688e-3187-4793-a805-64ab0e1feef3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:40.384470 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d091688e-3187-4793-a805-64ab0e1feef3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:40.384980 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d091688e-3187-4793-a805-64ab0e1feef3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:40.385765 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d091688e-3187-4793-a805-64ab0e1feef3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:40.386241 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d091688e-3187-4793-a805-64ab0e1feef3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:40.648134 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d091688e-3187-4793-a805-64ab0e1feef3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:40.675368 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d091688e-3187-4793-a805-64ab0e1feef3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:40.679127 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e12b7192-03df-4fd6-b74d-d1cbff02b21e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:40.681056 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d091688e-3187-4793-a805-64ab0e1feef3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:40.682829 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d091688e-3187-4793-a805-64ab0e1feef3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1407 microversion: 2.20 time: 0.309645 Nov 24 03:04:40.684637 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 46/104] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:04:40 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:04:40.685130 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e12b7192-03df-4fd6-b74d-d1cbff02b21e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:40.699059 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e12b7192-03df-4fd6-b74d-d1cbff02b21e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:40.699538 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e12b7192-03df-4fd6-b74d-d1cbff02b21e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:40.700386 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e12b7192-03df-4fd6-b74d-d1cbff02b21e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:40.700835 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e12b7192-03df-4fd6-b74d-d1cbff02b21e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:40.951277 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e12b7192-03df-4fd6-b74d-d1cbff02b21e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:40.963425 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e12b7192-03df-4fd6-b74d-d1cbff02b21e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.294309 Nov 24 03:04:40.964704 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 59/105] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:40 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:41.725678 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-26576b0c-70cd-4b88-9a3a-7fe65516c09b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:41.726885 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-26576b0c-70cd-4b88-9a3a-7fe65516c09b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:41.736127 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-26576b0c-70cd-4b88-9a3a-7fe65516c09b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:41.737163 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-26576b0c-70cd-4b88-9a3a-7fe65516c09b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:41.738619 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-26576b0c-70cd-4b88-9a3a-7fe65516c09b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:41.739295 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-26576b0c-70cd-4b88-9a3a-7fe65516c09b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:41.998188 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0da35fcf-d7a8-4a70-bf3d-3c62a93782b4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:41.999522 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0da35fcf-d7a8-4a70-bf3d-3c62a93782b4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:42.060116 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0da35fcf-d7a8-4a70-bf3d-3c62a93782b4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:42.061020 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0da35fcf-d7a8-4a70-bf3d-3c62a93782b4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:42.068924 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0da35fcf-d7a8-4a70-bf3d-3c62a93782b4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:42.069958 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0da35fcf-d7a8-4a70-bf3d-3c62a93782b4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:42.072615 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-26576b0c-70cd-4b88-9a3a-7fe65516c09b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:42.087940 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-26576b0c-70cd-4b88-9a3a-7fe65516c09b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:42.089781 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-26576b0c-70cd-4b88-9a3a-7fe65516c09b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:42.091154 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-26576b0c-70cd-4b88-9a3a-7fe65516c09b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1407 microversion: 2.20 time: 0.374212 Nov 24 03:04:42.092456 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 47/106] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:04:41 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1407 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:04:42.436320 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0da35fcf-d7a8-4a70-bf3d-3c62a93782b4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:42.452326 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0da35fcf-d7a8-4a70-bf3d-3c62a93782b4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.461531 Nov 24 03:04:42.465300 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 60/107] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:41 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:43.126880 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ac6c6e5d-efae-4398-827c-3d37c28bd69a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:43.129243 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ac6c6e5d-efae-4398-827c-3d37c28bd69a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:43.164513 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac6c6e5d-efae-4398-827c-3d37c28bd69a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:43.165340 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac6c6e5d-efae-4398-827c-3d37c28bd69a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:43.167177 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac6c6e5d-efae-4398-827c-3d37c28bd69a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:43.168287 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac6c6e5d-efae-4398-827c-3d37c28bd69a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:43.444617 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ac6c6e5d-efae-4398-827c-3d37c28bd69a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:43.473032 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ac6c6e5d-efae-4398-827c-3d37c28bd69a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:43.476562 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-6d033660-2a95-48e0-94e1-87595e7829fa tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:43.477394 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ac6c6e5d-efae-4398-827c-3d37c28bd69a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:43.478916 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-6d033660-2a95-48e0-94e1-87595e7829fa tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:43.480048 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ac6c6e5d-efae-4398-827c-3d37c28bd69a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1599 microversion: 2.20 time: 0.358878 Nov 24 03:04:43.488812 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6d033660-2a95-48e0-94e1-87595e7829fa tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:43.489593 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6d033660-2a95-48e0-94e1-87595e7829fa tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:43.491113 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6d033660-2a95-48e0-94e1-87595e7829fa tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:43.491470 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 48/108] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:04:43 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1599 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:04:43.492605 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6d033660-2a95-48e0-94e1-87595e7829fa tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:43.512096 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c61ebe50-7ca1-498b-b594-821cb7d9ca89 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:43.512875 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c61ebe50-7ca1-498b-b594-821cb7d9ca89 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:43.523356 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c61ebe50-7ca1-498b-b594-821cb7d9ca89 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:43.524657 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c61ebe50-7ca1-498b-b594-821cb7d9ca89 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:43.526325 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c61ebe50-7ca1-498b-b594-821cb7d9ca89 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:43.527328 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c61ebe50-7ca1-498b-b594-821cb7d9ca89 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:43.757444 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c61ebe50-7ca1-498b-b594-821cb7d9ca89 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.250962 Nov 24 03:04:43.758305 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 49/109] 10.222.0.52 () {60 vars in 1315 bytes} [Wed Nov 24 03:04:43 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/os-interface => generated 285 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 03:04:43.796021 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-6d033660-2a95-48e0-94e1-87595e7829fa tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:43.816250 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-6d033660-2a95-48e0-94e1-87595e7829fa tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.346101 Nov 24 03:04:43.829952 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 61/110] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:43 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:43.927306 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b678aea7-7aea-48bb-a8ce-16b7a32a05fa tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-345970104", "imageRef": "04860a4a-47c3-4532-865d-be6c9c493af7", "flavorRef": "452", "networks": [{"uuid": "3f10594b-6f86-48fa-a7b0-505b247d8265"}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:44.054909 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-b678aea7-7aea-48bb-a8ce-16b7a32a05fa tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] validate_networks() for [('3f10594b-6f86-48fa-a7b0-505b247d8265', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:04:44.844249 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-672fe29b-c2b8-4c50-a695-e658e8ae5cd2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:44.846221 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-672fe29b-c2b8-4c50-a695-e658e8ae5cd2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:44.861185 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-672fe29b-c2b8-4c50-a695-e658e8ae5cd2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:44.862246 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-672fe29b-c2b8-4c50-a695-e658e8ae5cd2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:44.863984 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-672fe29b-c2b8-4c50-a695-e658e8ae5cd2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:44.865835 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-672fe29b-c2b8-4c50-a695-e658e8ae5cd2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:45.194753 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-672fe29b-c2b8-4c50-a695-e658e8ae5cd2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:45.217174 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-672fe29b-c2b8-4c50-a695-e658e8ae5cd2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.377391 Nov 24 03:04:45.222254 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 62/111] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:44 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:45.904163 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-b678aea7-7aea-48bb-a8ce-16b7a32a05fa tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:04:45.905027 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-b678aea7-7aea-48bb-a8ce-16b7a32a05fa tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:04:45.905602 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-b678aea7-7aea-48bb-a8ce-16b7a32a05fa tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:04:45.906321 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-b678aea7-7aea-48bb-a8ce-16b7a32a05fa tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:04:45.906979 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-b678aea7-7aea-48bb-a8ce-16b7a32a05fa tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:04:45.941424 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b678aea7-7aea-48bb-a8ce-16b7a32a05fa tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:45.952295 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b678aea7-7aea-48bb-a8ce-16b7a32a05fa tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:45.954037 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b678aea7-7aea-48bb-a8ce-16b7a32a05fa tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:45.955529 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b678aea7-7aea-48bb-a8ce-16b7a32a05fa tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:46.050720 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-b678aea7-7aea-48bb-a8ce-16b7a32a05fa tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Getting quotas for project 0d8250c30ab9492ab167e4dd03c96be1. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:04:46.061852 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-b678aea7-7aea-48bb-a8ce-16b7a32a05fa tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Getting quotas for user 7721d1277c63459dacf166e44cacf3b5 and project 0d8250c30ab9492ab167e4dd03c96be1. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:04:46.108750 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b678aea7-7aea-48bb-a8ce-16b7a32a05fa tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:04:46.123014 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b678aea7-7aea-48bb-a8ce-16b7a32a05fa tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04860a4a-47c3-4532-865d-be6c9c493af7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:04:46.225546 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b678aea7-7aea-48bb-a8ce-16b7a32a05fa tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.303838 Nov 24 03:04:46.242788 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 50/112] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Nov 24 03:04:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 2314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 03:04:46.244535 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-1cb13673-fad0-459a-acca-0efcad4cb663 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:46.244535 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-1cb13673-fad0-459a-acca-0efcad4cb663 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:46.260741 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1cb13673-fad0-459a-acca-0efcad4cb663 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:46.260741 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1cb13673-fad0-459a-acca-0efcad4cb663 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:46.261217 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1cb13673-fad0-459a-acca-0efcad4cb663 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:46.261508 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1cb13673-fad0-459a-acca-0efcad4cb663 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:46.268360 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-73814201-2f79-4ba3-b3f4-7e35fab78d61 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:46.269256 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-73814201-2f79-4ba3-b3f4-7e35fab78d61 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:46.464872 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-73814201-2f79-4ba3-b3f4-7e35fab78d61 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:46.520765 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-73814201-2f79-4ba3-b3f4-7e35fab78d61 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 200 len: 1217 microversion: 2.1 time: 0.275697 Nov 24 03:04:46.532856 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 51/113] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:46 2021] GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 1217 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:46.769402 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-1cb13673-fad0-459a-acca-0efcad4cb663 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:46.803792 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-1cb13673-fad0-459a-acca-0efcad4cb663 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.565557 Nov 24 03:04:46.809974 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 63/114] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:46 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:47.073347 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-dcab28c9-61f9-44b8-84c0-4dd9cc73e4d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:47.075405 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-dcab28c9-61f9-44b8-84c0-4dd9cc73e4d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:47.083442 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-8bbe0d8f-8878-40a0-b257-85a2a45535e2 req-a53c00a7-e52a-4e05-9cb4-d067e482b5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfaf6d4e-4188-451d-8af8-32300d13ae2d", "tag": "521a966d-715d-42d8-a2e3-077f7788aac2"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:47.085663 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:04:47.085663 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:04:47.108708 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-8bbe0d8f-8878-40a0-b257-85a2a45535e2 req-a53c00a7-e52a-4e05-9cb4-d067e482b5e6 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:47.112945 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dcab28c9-61f9-44b8-84c0-4dd9cc73e4d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:47.115072 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dcab28c9-61f9-44b8-84c0-4dd9cc73e4d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:47.116331 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-8bbe0d8f-8878-40a0-b257-85a2a45535e2 req-a53c00a7-e52a-4e05-9cb4-d067e482b5e6 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:47.120507 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dcab28c9-61f9-44b8-84c0-4dd9cc73e4d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:47.120973 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dcab28c9-61f9-44b8-84c0-4dd9cc73e4d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:47.155494 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-8bbe0d8f-8878-40a0-b257-85a2a45535e2 req-a53c00a7-e52a-4e05-9cb4-d067e482b5e6 service nova] Creating event network-changed:521a966d-715d-42d8-a2e3-077f7788aac2 for instance dfaf6d4e-4188-451d-8af8-32300d13ae2d on hv-cinder-81803 Nov 24 03:04:47.165749 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-8bbe0d8f-8878-40a0-b257-85a2a45535e2 req-a53c00a7-e52a-4e05-9cb4-d067e482b5e6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086711 Nov 24 03:04:47.171049 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 64/115] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:04:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:04:47.551222 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-9a4da935-8d70-4a82-844e-c00ebac02625 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:47.552222 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-9a4da935-8d70-4a82-844e-c00ebac02625 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:47.571302 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9a4da935-8d70-4a82-844e-c00ebac02625 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:47.571799 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9a4da935-8d70-4a82-844e-c00ebac02625 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:47.580034 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9a4da935-8d70-4a82-844e-c00ebac02625 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:47.580464 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9a4da935-8d70-4a82-844e-c00ebac02625 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:47.683835 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-9a4da935-8d70-4a82-844e-c00ebac02625 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:47.708111 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-9a4da935-8d70-4a82-844e-c00ebac02625 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 200 len: 1221 microversion: 2.1 time: 0.160209 Nov 24 03:04:47.718324 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 65/116] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:47 2021] GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 1221 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:47.824058 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-313c839d-5f89-40d2-8533-03042597f4a2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:47.825160 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-313c839d-5f89-40d2-8533-03042597f4a2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:47.850907 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-313c839d-5f89-40d2-8533-03042597f4a2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:47.851910 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-313c839d-5f89-40d2-8533-03042597f4a2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:47.863646 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-313c839d-5f89-40d2-8533-03042597f4a2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:47.866323 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-313c839d-5f89-40d2-8533-03042597f4a2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:48.120918 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-313c839d-5f89-40d2-8533-03042597f4a2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:48.130813 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-313c839d-5f89-40d2-8533-03042597f4a2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.311815 Nov 24 03:04:48.132492 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 66/117] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:47 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:48.732844 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-63af446d-e053-458f-b53e-768a637bf39c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:48.733521 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-63af446d-e053-458f-b53e-768a637bf39c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:48.744089 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-63af446d-e053-458f-b53e-768a637bf39c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:48.744534 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-63af446d-e053-458f-b53e-768a637bf39c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:48.745342 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-63af446d-e053-458f-b53e-768a637bf39c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:48.745780 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-63af446d-e053-458f-b53e-768a637bf39c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:48.848570 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-63af446d-e053-458f-b53e-768a637bf39c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:48.857592 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-63af446d-e053-458f-b53e-768a637bf39c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 200 len: 1221 microversion: 2.1 time: 0.128651 Nov 24 03:04:48.859326 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 67/118] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:48 2021] GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 1221 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:49.149549 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4c667a73-2abb-45a9-b61a-ea0f9ae9439f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:49.150530 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4c667a73-2abb-45a9-b61a-ea0f9ae9439f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:49.157437 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4c667a73-2abb-45a9-b61a-ea0f9ae9439f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:49.158714 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4c667a73-2abb-45a9-b61a-ea0f9ae9439f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:49.159833 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4c667a73-2abb-45a9-b61a-ea0f9ae9439f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:49.160522 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4c667a73-2abb-45a9-b61a-ea0f9ae9439f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:49.376650 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4c667a73-2abb-45a9-b61a-ea0f9ae9439f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:49.394316 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4c667a73-2abb-45a9-b61a-ea0f9ae9439f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.247806 Nov 24 03:04:49.395436 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 68/119] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:49 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:49.875952 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-1b69bcc0-b3b9-45c4-ae05-b03da15b1a8f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:49.876868 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-1b69bcc0-b3b9-45c4-ae05-b03da15b1a8f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:49.884045 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1b69bcc0-b3b9-45c4-ae05-b03da15b1a8f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:49.884501 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1b69bcc0-b3b9-45c4-ae05-b03da15b1a8f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:49.885311 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1b69bcc0-b3b9-45c4-ae05-b03da15b1a8f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:49.885759 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1b69bcc0-b3b9-45c4-ae05-b03da15b1a8f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:49.973099 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-1b69bcc0-b3b9-45c4-ae05-b03da15b1a8f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:49.985660 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-1b69bcc0-b3b9-45c4-ae05-b03da15b1a8f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 200 len: 1221 microversion: 2.1 time: 0.113148 Nov 24 03:04:49.986836 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 69/120] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:49 2021] GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 1221 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:50.156202 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-dcab28c9-61f9-44b8-84c0-4dd9cc73e4d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 14 microversion: 2.20 time: 3.086239 Nov 24 03:04:50.161952 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 52/121] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:04:47 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 14 bytes in 3094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:50.420606 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-3388ed02-469b-4075-96f6-f8de9a75d95d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:50.421504 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-3388ed02-469b-4075-96f6-f8de9a75d95d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:50.434485 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3388ed02-469b-4075-96f6-f8de9a75d95d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:50.436214 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3388ed02-469b-4075-96f6-f8de9a75d95d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:50.448208 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3388ed02-469b-4075-96f6-f8de9a75d95d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:50.451712 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3388ed02-469b-4075-96f6-f8de9a75d95d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:50.757170 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-3388ed02-469b-4075-96f6-f8de9a75d95d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:50.773137 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-3388ed02-469b-4075-96f6-f8de9a75d95d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.362968 Nov 24 03:04:50.774715 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 70/122] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:50 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:51.007280 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ae0cc5af-e5e6-4b13-b00c-7ddf8fdf2055 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:51.008269 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ae0cc5af-e5e6-4b13-b00c-7ddf8fdf2055 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:51.027954 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae0cc5af-e5e6-4b13-b00c-7ddf8fdf2055 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:51.028751 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae0cc5af-e5e6-4b13-b00c-7ddf8fdf2055 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:51.029870 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae0cc5af-e5e6-4b13-b00c-7ddf8fdf2055 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:51.030344 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae0cc5af-e5e6-4b13-b00c-7ddf8fdf2055 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:51.159533 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ae0cc5af-e5e6-4b13-b00c-7ddf8fdf2055 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:51.177786 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-73ae8218-556e-4f60-8417-aab63649efad tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:51.178766 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ae0cc5af-e5e6-4b13-b00c-7ddf8fdf2055 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 200 len: 1269 microversion: 2.1 time: 0.174920 Nov 24 03:04:51.178906 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-73ae8218-556e-4f60-8417-aab63649efad tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:51.181641 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 53/123] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:51 2021] GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 1269 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:51.217502 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-73ae8218-556e-4f60-8417-aab63649efad tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:51.228819 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-73ae8218-556e-4f60-8417-aab63649efad tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:51.229240 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-73ae8218-556e-4f60-8417-aab63649efad tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:51.229699 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-73ae8218-556e-4f60-8417-aab63649efad tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:51.357867 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-73ae8218-556e-4f60-8417-aab63649efad tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 14 microversion: 2.20 time: 0.187906 Nov 24 03:04:51.362255 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 71/124] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:04:51 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:51.733276 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d9f934f7-08a3-4afe-b5a8-79597324150a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:51.733951 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d9f934f7-08a3-4afe-b5a8-79597324150a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:51.742305 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d9f934f7-08a3-4afe-b5a8-79597324150a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:51.742877 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d9f934f7-08a3-4afe-b5a8-79597324150a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:51.743820 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d9f934f7-08a3-4afe-b5a8-79597324150a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:51.744433 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d9f934f7-08a3-4afe-b5a8-79597324150a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:51.797556 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-68ea5a88-7d6e-4afc-8c8b-b56efacc68ad tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:51.798730 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-68ea5a88-7d6e-4afc-8c8b-b56efacc68ad tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:51.806294 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d9f934f7-08a3-4afe-b5a8-79597324150a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:04:51.808331 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-68ea5a88-7d6e-4afc-8c8b-b56efacc68ad tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:51.808801 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-68ea5a88-7d6e-4afc-8c8b-b56efacc68ad tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:51.809744 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-68ea5a88-7d6e-4afc-8c8b-b56efacc68ad tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:51.810317 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-68ea5a88-7d6e-4afc-8c8b-b56efacc68ad tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:52.027685 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d9f934f7-08a3-4afe-b5a8-79597324150a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 204 len: 0 microversion: 2.1 time: 0.297577 Nov 24 03:04:52.028873 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 54/125] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:04:51 2021] DELETE /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:04:52.049141 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-68ea5a88-7d6e-4afc-8c8b-b56efacc68ad tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:52.057592 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-297811d9-8a23-4b67-8062-2e7d4986de6f tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:52.060739 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-68ea5a88-7d6e-4afc-8c8b-b56efacc68ad tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.265753 Nov 24 03:04:52.062081 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 72/126] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:51 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:52.064660 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-297811d9-8a23-4b67-8062-2e7d4986de6f tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:52.087601 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-297811d9-8a23-4b67-8062-2e7d4986de6f tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:52.089831 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-297811d9-8a23-4b67-8062-2e7d4986de6f tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:52.092194 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-297811d9-8a23-4b67-8062-2e7d4986de6f tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:52.093015 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-297811d9-8a23-4b67-8062-2e7d4986de6f tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:52.197985 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2df2bbfd-3459-4ee5-9c4b-1a0a5640d072 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:52.198870 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2df2bbfd-3459-4ee5-9c4b-1a0a5640d072 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:52.211807 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2df2bbfd-3459-4ee5-9c4b-1a0a5640d072 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:52.212526 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2df2bbfd-3459-4ee5-9c4b-1a0a5640d072 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:52.216294 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2df2bbfd-3459-4ee5-9c4b-1a0a5640d072 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:52.218572 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2df2bbfd-3459-4ee5-9c4b-1a0a5640d072 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:52.368251 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2df2bbfd-3459-4ee5-9c4b-1a0a5640d072 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:52.405513 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2df2bbfd-3459-4ee5-9c4b-1a0a5640d072 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 200 len: 1275 microversion: 2.1 time: 0.211704 Nov 24 03:04:52.406770 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 73/127] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:52 2021] GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 1275 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:52.426821 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-30d05909-d144-4df9-a151-cb94e09eb241 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:52.428554 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-30d05909-d144-4df9-a151-cb94e09eb241 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:52.453874 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-30d05909-d144-4df9-a151-cb94e09eb241 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:52.458641 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-30d05909-d144-4df9-a151-cb94e09eb241 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:52.461133 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-30d05909-d144-4df9-a151-cb94e09eb241 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:52.469766 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-30d05909-d144-4df9-a151-cb94e09eb241 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:52.574603 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-30d05909-d144-4df9-a151-cb94e09eb241 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 14 microversion: 2.20 time: 0.160215 Nov 24 03:04:52.577112 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 74/128] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:04:52 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:52.730808 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-297811d9-8a23-4b67-8062-2e7d4986de6f tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:52.753242 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-297811d9-8a23-4b67-8062-2e7d4986de6f tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1553 microversion: 2.1 time: 0.708400 Nov 24 03:04:52.755598 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 55/129] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:52 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1553 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:53.080105 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-80783d53-3557-484f-886f-6fc2ba3f152b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:53.081760 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-80783d53-3557-484f-886f-6fc2ba3f152b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:53.090462 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-80783d53-3557-484f-886f-6fc2ba3f152b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:53.091346 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-80783d53-3557-484f-886f-6fc2ba3f152b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:53.092498 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-80783d53-3557-484f-886f-6fc2ba3f152b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:53.093331 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-80783d53-3557-484f-886f-6fc2ba3f152b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:53.357887 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-80783d53-3557-484f-886f-6fc2ba3f152b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:53.373854 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-80783d53-3557-484f-886f-6fc2ba3f152b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.297966 Nov 24 03:04:53.378613 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 75/130] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:53 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:53.426963 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-24be666d-1f16-4d91-952b-0cbf41fc9fb6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:53.428555 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-24be666d-1f16-4d91-952b-0cbf41fc9fb6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:53.437793 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-24be666d-1f16-4d91-952b-0cbf41fc9fb6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:53.438747 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-24be666d-1f16-4d91-952b-0cbf41fc9fb6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:53.440055 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-24be666d-1f16-4d91-952b-0cbf41fc9fb6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:53.441408 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-24be666d-1f16-4d91-952b-0cbf41fc9fb6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:53.602461 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-74b96ba7-305d-4031-92a7-d0e9cc61a694 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:53.604507 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-74b96ba7-305d-4031-92a7-d0e9cc61a694 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:53.620596 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-74b96ba7-305d-4031-92a7-d0e9cc61a694 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:53.622220 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-74b96ba7-305d-4031-92a7-d0e9cc61a694 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:53.624562 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-74b96ba7-305d-4031-92a7-d0e9cc61a694 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:53.625490 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-74b96ba7-305d-4031-92a7-d0e9cc61a694 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:53.726418 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-74b96ba7-305d-4031-92a7-d0e9cc61a694 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 14 microversion: 2.20 time: 0.129863 Nov 24 03:04:53.728430 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 76/131] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:04:53 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:53.789392 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-9596c445-2e76-4277-a46f-5c50f826869a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:53.790743 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-9596c445-2e76-4277-a46f-5c50f826869a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:53.839361 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9596c445-2e76-4277-a46f-5c50f826869a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:53.840136 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9596c445-2e76-4277-a46f-5c50f826869a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:53.850227 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9596c445-2e76-4277-a46f-5c50f826869a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:53.851395 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9596c445-2e76-4277-a46f-5c50f826869a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:53.921051 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-24be666d-1f16-4d91-952b-0cbf41fc9fb6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:53.936277 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-24be666d-1f16-4d91-952b-0cbf41fc9fb6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 200 len: 1317 microversion: 2.1 time: 0.515274 Nov 24 03:04:53.939039 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 56/132] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:53 2021] GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:54.313033 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-9596c445-2e76-4277-a46f-5c50f826869a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:54.350620 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-9596c445-2e76-4277-a46f-5c50f826869a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1553 microversion: 2.1 time: 0.577860 Nov 24 03:04:54.351242 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 77/133] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:53 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1553 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:54.418325 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c66d05b3-8c5d-49f5-b0f5-67f3bdb14779 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:54.420119 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c66d05b3-8c5d-49f5-b0f5-67f3bdb14779 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:54.457313 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c66d05b3-8c5d-49f5-b0f5-67f3bdb14779 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:54.457777 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c66d05b3-8c5d-49f5-b0f5-67f3bdb14779 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:54.469655 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c66d05b3-8c5d-49f5-b0f5-67f3bdb14779 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:54.475616 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c66d05b3-8c5d-49f5-b0f5-67f3bdb14779 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:54.483978 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-9b9cfa4a-5a73-4595-9bf0-7193dec39469 req-18d084f6-3f7d-4c63-b309-cc47ed561f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba70ac89-9809-498b-9501-9c29c63b0519", "tag": "fccf5b03-6c42-421d-bf50-f86815f42c74"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:54.486803 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:04:54.486803 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:04:54.508400 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-9b9cfa4a-5a73-4595-9bf0-7193dec39469 req-18d084f6-3f7d-4c63-b309-cc47ed561f40 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:54.514103 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-9b9cfa4a-5a73-4595-9bf0-7193dec39469 req-18d084f6-3f7d-4c63-b309-cc47ed561f40 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:54.555472 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-9b9cfa4a-5a73-4595-9bf0-7193dec39469 req-18d084f6-3f7d-4c63-b309-cc47ed561f40 service nova] Creating event network-changed:fccf5b03-6c42-421d-bf50-f86815f42c74 for instance ba70ac89-9809-498b-9501-9c29c63b0519 on hv-cinder-81803 Nov 24 03:04:54.583064 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-9b9cfa4a-5a73-4595-9bf0-7193dec39469 req-18d084f6-3f7d-4c63-b309-cc47ed561f40 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107214 Nov 24 03:04:54.584279 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 78/134] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:04:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:04:54.764582 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2ab1685f-93ae-49e5-982d-876cbe61d752 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:54.773308 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2ab1685f-93ae-49e5-982d-876cbe61d752 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:54.787463 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ab1685f-93ae-49e5-982d-876cbe61d752 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:54.788197 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ab1685f-93ae-49e5-982d-876cbe61d752 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:54.789423 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ab1685f-93ae-49e5-982d-876cbe61d752 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:54.790593 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ab1685f-93ae-49e5-982d-876cbe61d752 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:54.872586 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2ab1685f-93ae-49e5-982d-876cbe61d752 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 14 microversion: 2.20 time: 0.133760 Nov 24 03:04:54.873427 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 79/135] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:04:54 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:54.920133 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c66d05b3-8c5d-49f5-b0f5-67f3bdb14779 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:54.937173 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c66d05b3-8c5d-49f5-b0f5-67f3bdb14779 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.533350 Nov 24 03:04:54.942075 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 57/136] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:54 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:54.974228 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4787d6e5-a0f3-4e60-9624-6211047fa643 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:54.975931 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4787d6e5-a0f3-4e60-9624-6211047fa643 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:54.989398 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4787d6e5-a0f3-4e60-9624-6211047fa643 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:54.990581 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4787d6e5-a0f3-4e60-9624-6211047fa643 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:54.992249 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4787d6e5-a0f3-4e60-9624-6211047fa643 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:54.994023 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4787d6e5-a0f3-4e60-9624-6211047fa643 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:55.379886 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-def7232e-4200-4edd-abb8-6b5cd6746c3a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:55.380629 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-def7232e-4200-4edd-abb8-6b5cd6746c3a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:55.391952 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-def7232e-4200-4edd-abb8-6b5cd6746c3a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:55.392176 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4787d6e5-a0f3-4e60-9624-6211047fa643 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:55.394125 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-def7232e-4200-4edd-abb8-6b5cd6746c3a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:55.395380 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-def7232e-4200-4edd-abb8-6b5cd6746c3a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:55.397686 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-def7232e-4200-4edd-abb8-6b5cd6746c3a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:55.430478 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4787d6e5-a0f3-4e60-9624-6211047fa643 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 200 len: 1317 microversion: 2.1 time: 0.468616 Nov 24 03:04:55.431833 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 80/137] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:54 2021] GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:55.826327 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-66721de2-3749-48bf-b5c0-a401e8fc252b req-a94f6fe0-91b0-46a5-b01e-de921f288b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7336735a-138d-4072-a48b-30b6741211cb", "name": "network-vif-deleted", "tag": "2c9cdbfc-f976-4a05-b58d-e0d5a3660703"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:55.847575 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:04:55.847575 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:04:55.885394 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-66721de2-3749-48bf-b5c0-a401e8fc252b req-a94f6fe0-91b0-46a5-b01e-de921f288b10 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:55.893111 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-66721de2-3749-48bf-b5c0-a401e8fc252b req-a94f6fe0-91b0-46a5-b01e-de921f288b10 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:55.949824 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-66721de2-3749-48bf-b5c0-a401e8fc252b req-a94f6fe0-91b0-46a5-b01e-de921f288b10 service nova] Creating event network-vif-deleted:2c9cdbfc-f976-4a05-b58d-e0d5a3660703 for instance 7336735a-138d-4072-a48b-30b6741211cb on hv-cinder-81803 Nov 24 03:04:55.961386 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-66721de2-3749-48bf-b5c0-a401e8fc252b req-a94f6fe0-91b0-46a5-b01e-de921f288b10 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153063 Nov 24 03:04:55.964585 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 81/138] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:04:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:04:55.982759 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-d7e8e8bc-a3f3-4f57-8a6b-226d77df0dcf tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:55.991402 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-d7e8e8bc-a3f3-4f57-8a6b-226d77df0dcf tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:56.034139 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d7e8e8bc-a3f3-4f57-8a6b-226d77df0dcf tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:56.037343 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d7e8e8bc-a3f3-4f57-8a6b-226d77df0dcf tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:56.039972 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d7e8e8bc-a3f3-4f57-8a6b-226d77df0dcf tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:56.041998 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d7e8e8bc-a3f3-4f57-8a6b-226d77df0dcf tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:56.123689 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-def7232e-4200-4edd-abb8-6b5cd6746c3a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:56.144826 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-def7232e-4200-4edd-abb8-6b5cd6746c3a tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1553 microversion: 2.1 time: 0.766986 Nov 24 03:04:56.155251 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 58/139] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:55 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1553 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:56.162182 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f6f0ac4a-bfe1-4a2d-9529-99df7824312c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:56.166079 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f6f0ac4a-bfe1-4a2d-9529-99df7824312c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:56.204402 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f6f0ac4a-bfe1-4a2d-9529-99df7824312c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:56.218190 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f6f0ac4a-bfe1-4a2d-9529-99df7824312c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:56.218190 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f6f0ac4a-bfe1-4a2d-9529-99df7824312c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:56.218190 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f6f0ac4a-bfe1-4a2d-9529-99df7824312c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:56.250117 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-d7e8e8bc-a3f3-4f57-8a6b-226d77df0dcf tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 14 microversion: 2.20 time: 0.282709 Nov 24 03:04:56.254392 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 82/140] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:04:55 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 14 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:56.470996 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-79b5e857-1b82-448f-b026-4631aa0bfd09 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:56.472274 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-79b5e857-1b82-448f-b026-4631aa0bfd09 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:56.512930 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-79b5e857-1b82-448f-b026-4631aa0bfd09 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:56.515405 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-79b5e857-1b82-448f-b026-4631aa0bfd09 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:56.516742 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-79b5e857-1b82-448f-b026-4631aa0bfd09 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:56.518144 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-79b5e857-1b82-448f-b026-4631aa0bfd09 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:56.777994 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f6f0ac4a-bfe1-4a2d-9529-99df7824312c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:56.788998 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f6f0ac4a-bfe1-4a2d-9529-99df7824312c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.632164 Nov 24 03:04:56.790651 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 59/141] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:56 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:57.019911 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-79b5e857-1b82-448f-b026-4631aa0bfd09 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:57.031664 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-79b5e857-1b82-448f-b026-4631aa0bfd09 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 200 len: 1317 microversion: 2.1 time: 0.574677 Nov 24 03:04:57.044014 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 83/142] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:56 2021] GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 1317 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:57.163698 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b463a844-2394-420c-b144-ecd64f1aadaa tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:57.164215 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b463a844-2394-420c-b144-ecd64f1aadaa tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:57.171882 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b463a844-2394-420c-b144-ecd64f1aadaa tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:57.172446 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b463a844-2394-420c-b144-ecd64f1aadaa tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:57.173467 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b463a844-2394-420c-b144-ecd64f1aadaa tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:57.175434 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b463a844-2394-420c-b144-ecd64f1aadaa tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:57.229173 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b463a844-2394-420c-b144-ecd64f1aadaa tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:57.229687 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b463a844-2394-420c-b144-ecd64f1aadaa tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:57.230337 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-b463a844-2394-420c-b144-ecd64f1aadaa tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lazy-loading 'fault' on Instance uuid 7336735a-138d-4072-a48b-30b6741211cb {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:04:57.286526 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e32839f5-30f8-426a-978e-9d450e1f71ee tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:57.288941 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e32839f5-30f8-426a-978e-9d450e1f71ee tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:57.295119 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b463a844-2394-420c-b144-ecd64f1aadaa tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912f1e73cdbe4c42986a15f827d15479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1550be2c2e954fe0b225bf7a5a4c2e3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:57.305387 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b463a844-2394-420c-b144-ecd64f1aadaa tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 200 len: 1351 microversion: 2.1 time: 0.145783 Nov 24 03:04:57.317174 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 60/143] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:57 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 1351 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:04:57.320154 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e32839f5-30f8-426a-978e-9d450e1f71ee tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:57.321033 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e32839f5-30f8-426a-978e-9d450e1f71ee tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:57.324993 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e32839f5-30f8-426a-978e-9d450e1f71ee tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:57.328038 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e32839f5-30f8-426a-978e-9d450e1f71ee tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:57.529001 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e32839f5-30f8-426a-978e-9d450e1f71ee tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 14 microversion: 2.20 time: 0.267267 Nov 24 03:04:57.535643 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 84/144] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:04:57 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 14 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:57.828472 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-aa7171cc-269f-414b-87b5-bd29d04832ea tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:57.833836 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-aa7171cc-269f-414b-87b5-bd29d04832ea tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:57.858242 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aa7171cc-269f-414b-87b5-bd29d04832ea tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:57.858685 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aa7171cc-269f-414b-87b5-bd29d04832ea tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:57.859742 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aa7171cc-269f-414b-87b5-bd29d04832ea tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:57.860369 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aa7171cc-269f-414b-87b5-bd29d04832ea tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:58.061412 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2c6f0fc4-0467-42c4-a626-48f9dcd6f335 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:58.063321 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2c6f0fc4-0467-42c4-a626-48f9dcd6f335 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:58.100233 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2c6f0fc4-0467-42c4-a626-48f9dcd6f335 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:58.101092 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2c6f0fc4-0467-42c4-a626-48f9dcd6f335 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:58.102729 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2c6f0fc4-0467-42c4-a626-48f9dcd6f335 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:58.103479 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2c6f0fc4-0467-42c4-a626-48f9dcd6f335 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:58.145278 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-aa7171cc-269f-414b-87b5-bd29d04832ea tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:58.159396 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-aa7171cc-269f-414b-87b5-bd29d04832ea tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.353285 Nov 24 03:04:58.160049 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 61/145] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:57 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:58.333457 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7fc16a7e-0bde-4625-913e-bebaef7ba0e8 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:58.336082 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7fc16a7e-0bde-4625-913e-bebaef7ba0e8 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:58.348992 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7fc16a7e-0bde-4625-913e-bebaef7ba0e8 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:58.349717 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7fc16a7e-0bde-4625-913e-bebaef7ba0e8 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:58.351176 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7fc16a7e-0bde-4625-913e-bebaef7ba0e8 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:58.352605 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7fc16a7e-0bde-4625-913e-bebaef7ba0e8 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:58.385627 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-7fc16a7e-0bde-4625-913e-bebaef7ba0e8 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] HTTP exception thrown: Instance 7336735a-138d-4072-a48b-30b6741211cb could not be found. Nov 24 03:04:58.388797 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7fc16a7e-0bde-4625-913e-bebaef7ba0e8 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Returning 404 to user: Instance 7336735a-138d-4072-a48b-30b6741211cb could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:04:58.390697 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7fc16a7e-0bde-4625-913e-bebaef7ba0e8 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 404 len: 111 microversion: 2.1 time: 0.069294 Nov 24 03:04:58.400995 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 62/146] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:58 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:04:58.406855 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2c6f0fc4-0467-42c4-a626-48f9dcd6f335 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:58.421404 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2c6f0fc4-0467-42c4-a626-48f9dcd6f335 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 200 len: 1317 microversion: 2.1 time: 0.374637 Nov 24 03:04:58.441171 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 85/147] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:58 2021] GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:58.546940 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c4ba61d3-47ca-4b0e-97af-97d5847e399b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:58.548761 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c4ba61d3-47ca-4b0e-97af-97d5847e399b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:58.582370 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4ba61d3-47ca-4b0e-97af-97d5847e399b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:58.583417 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4ba61d3-47ca-4b0e-97af-97d5847e399b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:58.585254 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4ba61d3-47ca-4b0e-97af-97d5847e399b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:58.586391 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4ba61d3-47ca-4b0e-97af-97d5847e399b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:58.615586 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-48ab9385-d748-4789-8b53-3400d80196e6 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:58.617453 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-48ab9385-d748-4789-8b53-3400d80196e6 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:58.628144 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-48ab9385-d748-4789-8b53-3400d80196e6 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:58.629183 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-48ab9385-d748-4789-8b53-3400d80196e6 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:58.630444 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-48ab9385-d748-4789-8b53-3400d80196e6 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:58.631109 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-48ab9385-d748-4789-8b53-3400d80196e6 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:58.651400 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-48ab9385-d748-4789-8b53-3400d80196e6 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] HTTP exception thrown: Instance 7336735a-138d-4072-a48b-30b6741211cb could not be found. Nov 24 03:04:58.652644 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-48ab9385-d748-4789-8b53-3400d80196e6 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Returning 404 to user: Instance 7336735a-138d-4072-a48b-30b6741211cb could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:04:58.654970 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-48ab9385-d748-4789-8b53-3400d80196e6 tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044954 Nov 24 03:04:58.661967 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 86/148] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Nov 24 03:04:58 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb/os-volume_attachments => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:04:58.695620 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c4ba61d3-47ca-4b0e-97af-97d5847e399b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 14 microversion: 2.20 time: 0.156186 Nov 24 03:04:58.699617 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 63/149] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:04:58 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:59.193700 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-6a7c878b-6e80-4010-a06f-a4fe388819a9 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:59.194964 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-6a7c878b-6e80-4010-a06f-a4fe388819a9 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:59.205070 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6a7c878b-6e80-4010-a06f-a4fe388819a9 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:59.205587 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6a7c878b-6e80-4010-a06f-a4fe388819a9 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:59.206517 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6a7c878b-6e80-4010-a06f-a4fe388819a9 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:59.206959 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6a7c878b-6e80-4010-a06f-a4fe388819a9 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:59.447005 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-42949021-7b27-4570-b8c0-2e22eec357bb tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:59.449417 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-42949021-7b27-4570-b8c0-2e22eec357bb tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:59.467155 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-42949021-7b27-4570-b8c0-2e22eec357bb tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:59.468265 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-42949021-7b27-4570-b8c0-2e22eec357bb tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:59.470737 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-42949021-7b27-4570-b8c0-2e22eec357bb tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:59.471992 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-42949021-7b27-4570-b8c0-2e22eec357bb tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:59.707050 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-6a7c878b-6e80-4010-a06f-a4fe388819a9 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:59.724759 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-6a7c878b-6e80-4010-a06f-a4fe388819a9 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.547004 Nov 24 03:04:59.739417 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 87/150] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:59 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:59.756967 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-6cd7f7cc-c462-40fa-8943-ede0032dd526 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:04:59.759353 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-6cd7f7cc-c462-40fa-8943-ede0032dd526 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:59.771771 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6cd7f7cc-c462-40fa-8943-ede0032dd526 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:59.773107 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6cd7f7cc-c462-40fa-8943-ede0032dd526 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:59.774852 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6cd7f7cc-c462-40fa-8943-ede0032dd526 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:59.775857 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6cd7f7cc-c462-40fa-8943-ede0032dd526 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:59.791795 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-42949021-7b27-4570-b8c0-2e22eec357bb tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:04:59.805447 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-42949021-7b27-4570-b8c0-2e22eec357bb tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 200 len: 1317 microversion: 2.1 time: 0.367087 Nov 24 03:04:59.806238 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 64/151] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:59 2021] GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:59.879126 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-6cd7f7cc-c462-40fa-8943-ede0032dd526 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 14 microversion: 2.20 time: 0.137397 Nov 24 03:04:59.880757 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 88/152] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:04:59 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:04:59.917233 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-714b1bdd-ff38-43b9-aefa-5fb39750fb1f tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:59.918098 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-714b1bdd-ff38-43b9-aefa-5fb39750fb1f tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:59.926250 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-714b1bdd-ff38-43b9-aefa-5fb39750fb1f tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:59.926910 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-714b1bdd-ff38-43b9-aefa-5fb39750fb1f tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:59.927883 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-714b1bdd-ff38-43b9-aefa-5fb39750fb1f tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:59.928470 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-714b1bdd-ff38-43b9-aefa-5fb39750fb1f tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:59.950350 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-714b1bdd-ff38-43b9-aefa-5fb39750fb1f tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] HTTP exception thrown: Instance 7336735a-138d-4072-a48b-30b6741211cb could not be found. Nov 24 03:04:59.951322 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-714b1bdd-ff38-43b9-aefa-5fb39750fb1f tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Returning 404 to user: Instance 7336735a-138d-4072-a48b-30b6741211cb could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:04:59.952965 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-714b1bdd-ff38-43b9-aefa-5fb39750fb1f tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 404 len: 111 microversion: 2.1 time: 0.040577 Nov 24 03:04:59.958420 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 65/153] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:04:59 2021] DELETE /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:04:59.967276 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-28a43e5a-997b-465d-8ad7-d7a63139822e tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:04:59.968467 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-28a43e5a-997b-465d-8ad7-d7a63139822e tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] [instance: 7336735a-138d-4072-a48b-30b6741211cb] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:04:59.979355 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-28a43e5a-997b-465d-8ad7-d7a63139822e tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:59.979951 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-28a43e5a-997b-465d-8ad7-d7a63139822e tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:04:59.980925 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-28a43e5a-997b-465d-8ad7-d7a63139822e tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:04:59.981513 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-28a43e5a-997b-465d-8ad7-d7a63139822e tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:00.003758 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-28a43e5a-997b-465d-8ad7-d7a63139822e tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] HTTP exception thrown: Instance 7336735a-138d-4072-a48b-30b6741211cb could not be found. Nov 24 03:05:00.004729 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-28a43e5a-997b-465d-8ad7-d7a63139822e tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] Returning 404 to user: Instance 7336735a-138d-4072-a48b-30b6741211cb could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:05:00.006213 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-28a43e5a-997b-465d-8ad7-d7a63139822e tempest-DeleteServersTestJSON-2032751473 tempest-DeleteServersTestJSON-2032751473-project] 10.222.0.52 "GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb" status: 404 len: 111 microversion: 2.1 time: 0.045422 Nov 24 03:05:00.007174 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 89/154] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:04:59 2021] GET /compute/v2.1/servers/7336735a-138d-4072-a48b-30b6741211cb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:05:00.763105 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0d6689c2-162c-43c2-8f30-cb7376e6e870 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:00.765269 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0d6689c2-162c-43c2-8f30-cb7376e6e870 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:00.779760 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d6689c2-162c-43c2-8f30-cb7376e6e870 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:00.781541 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d6689c2-162c-43c2-8f30-cb7376e6e870 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:00.784450 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d6689c2-162c-43c2-8f30-cb7376e6e870 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:00.785583 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d6689c2-162c-43c2-8f30-cb7376e6e870 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:00.836801 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-62c36631-9ce6-4e22-963d-93ec91d9ba0e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:00.839426 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-62c36631-9ce6-4e22-963d-93ec91d9ba0e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:00.861248 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-62c36631-9ce6-4e22-963d-93ec91d9ba0e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:00.863311 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-62c36631-9ce6-4e22-963d-93ec91d9ba0e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:00.867272 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-62c36631-9ce6-4e22-963d-93ec91d9ba0e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:00.870732 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-62c36631-9ce6-4e22-963d-93ec91d9ba0e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:01.306604 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-62c36631-9ce6-4e22-963d-93ec91d9ba0e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:01.313169 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0d6689c2-162c-43c2-8f30-cb7376e6e870 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:01.318791 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-62c36631-9ce6-4e22-963d-93ec91d9ba0e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 200 len: 1317 microversion: 2.1 time: 0.490983 Nov 24 03:05:01.322485 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0d6689c2-162c-43c2-8f30-cb7376e6e870 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.569632 Nov 24 03:05:01.331423 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 90/155] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:00 2021] GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:01.337579 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 66/156] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:00 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:01.339601 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f47c1858-0570-40bf-abc6-1a4da296c4de tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:01.340620 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f47c1858-0570-40bf-abc6-1a4da296c4de tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:01.349086 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f47c1858-0570-40bf-abc6-1a4da296c4de tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:01.349992 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f47c1858-0570-40bf-abc6-1a4da296c4de tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:01.350921 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f47c1858-0570-40bf-abc6-1a4da296c4de tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:01.351789 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f47c1858-0570-40bf-abc6-1a4da296c4de tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:01.453130 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f47c1858-0570-40bf-abc6-1a4da296c4de tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 10009 microversion: 2.20 time: 0.119769 Nov 24 03:05:01.454356 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 91/157] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:01 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 10009 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:02.346576 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7a99845b-0747-4e50-a6a3-5af631da85ed tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:02.348596 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7a99845b-0747-4e50-a6a3-5af631da85ed tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:02.351158 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-143649b5-ede5-4a11-9891-18037755b0e8 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:02.354927 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-143649b5-ede5-4a11-9891-18037755b0e8 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:02.364957 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7a99845b-0747-4e50-a6a3-5af631da85ed tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:02.366446 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7a99845b-0747-4e50-a6a3-5af631da85ed tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:02.368148 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7a99845b-0747-4e50-a6a3-5af631da85ed tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:02.369725 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7a99845b-0747-4e50-a6a3-5af631da85ed tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:02.387793 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-143649b5-ede5-4a11-9891-18037755b0e8 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:02.388695 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-143649b5-ede5-4a11-9891-18037755b0e8 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:02.399511 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-143649b5-ede5-4a11-9891-18037755b0e8 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:02.400346 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-143649b5-ede5-4a11-9891-18037755b0e8 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:02.717157 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7a99845b-0747-4e50-a6a3-5af631da85ed tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:02.730176 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7a99845b-0747-4e50-a6a3-5af631da85ed tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 200 len: 1317 microversion: 2.1 time: 0.392761 Nov 24 03:05:02.732213 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 67/158] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:02 2021] GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:02.742824 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-7a8ea131-f7ae-4a32-9ff3-3681261bb152 req-902c050c-8506-443b-bca3-b7db75083cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba70ac89-9809-498b-9501-9c29c63b0519", "name": "network-vif-plugged", "status": "completed", "tag": "fccf5b03-6c42-421d-bf50-f86815f42c74"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:02.746625 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:05:02.746625 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:05:02.762406 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-7a8ea131-f7ae-4a32-9ff3-3681261bb152 req-902c050c-8506-443b-bca3-b7db75083cd4 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:02.763530 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-7a8ea131-f7ae-4a32-9ff3-3681261bb152 req-902c050c-8506-443b-bca3-b7db75083cd4 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:02.787599 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-7a8ea131-f7ae-4a32-9ff3-3681261bb152 req-902c050c-8506-443b-bca3-b7db75083cd4 service nova] Creating event network-vif-plugged:fccf5b03-6c42-421d-bf50-f86815f42c74 for instance ba70ac89-9809-498b-9501-9c29c63b0519 on hv-cinder-81803 Nov 24 03:05:02.798998 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-7a8ea131-f7ae-4a32-9ff3-3681261bb152 req-902c050c-8506-443b-bca3-b7db75083cd4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063899 Nov 24 03:05:02.806430 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 68/159] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:05:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:05:02.824319 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5997171a-a920-4f41-b45a-66f593fe93c3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:02.833760 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5997171a-a920-4f41-b45a-66f593fe93c3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:02.855739 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5997171a-a920-4f41-b45a-66f593fe93c3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:02.856524 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5997171a-a920-4f41-b45a-66f593fe93c3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:02.865222 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5997171a-a920-4f41-b45a-66f593fe93c3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:02.866107 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5997171a-a920-4f41-b45a-66f593fe93c3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:02.868277 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-143649b5-ede5-4a11-9891-18037755b0e8 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:02.891461 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-143649b5-ede5-4a11-9891-18037755b0e8 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.546707 Nov 24 03:05:02.909355 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 92/160] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:02 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:03.107501 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5997171a-a920-4f41-b45a-66f593fe93c3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 18083 microversion: 2.20 time: 0.255685 Nov 24 03:05:03.116333 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 69/161] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:02 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 18083 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:03.762079 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-1b7405dd-22fc-455c-a38e-69844a99ced9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:03.766973 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-1b7405dd-22fc-455c-a38e-69844a99ced9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:03.779294 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1b7405dd-22fc-455c-a38e-69844a99ced9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:03.780305 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1b7405dd-22fc-455c-a38e-69844a99ced9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:03.781780 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1b7405dd-22fc-455c-a38e-69844a99ced9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:03.785693 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1b7405dd-22fc-455c-a38e-69844a99ced9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:03.930281 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6789a76a-7d30-418b-912a-7c94552b4ac7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:03.932846 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6789a76a-7d30-418b-912a-7c94552b4ac7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:03.955891 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6789a76a-7d30-418b-912a-7c94552b4ac7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:03.956629 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6789a76a-7d30-418b-912a-7c94552b4ac7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:03.958035 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6789a76a-7d30-418b-912a-7c94552b4ac7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:03.958767 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6789a76a-7d30-418b-912a-7c94552b4ac7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:04.142742 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-1b7405dd-22fc-455c-a38e-69844a99ced9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:04.168470 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-1b7405dd-22fc-455c-a38e-69844a99ced9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 200 len: 1317 microversion: 2.1 time: 0.413681 Nov 24 03:05:04.172630 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 93/162] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:03 2021] GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:05:04.184260 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-092fdc8c-34eb-4705-8663-bc31bafd66cf tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:04.189277 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-092fdc8c-34eb-4705-8663-bc31bafd66cf tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:04.202026 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-092fdc8c-34eb-4705-8663-bc31bafd66cf tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:04.202859 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-092fdc8c-34eb-4705-8663-bc31bafd66cf tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:04.206697 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-092fdc8c-34eb-4705-8663-bc31bafd66cf tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:04.207508 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-092fdc8c-34eb-4705-8663-bc31bafd66cf tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:04.352167 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-092fdc8c-34eb-4705-8663-bc31bafd66cf tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 18678 microversion: 2.20 time: 0.176512 Nov 24 03:05:04.352972 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 94/163] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:04 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 18678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:04.403397 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6789a76a-7d30-418b-912a-7c94552b4ac7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:04.414500 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6789a76a-7d30-418b-912a-7c94552b4ac7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.495200 Nov 24 03:05:04.416636 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 70/164] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:03 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:05.193374 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f9c53cb5-8d6c-4c16-b81f-fe3d2656a1bc tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:05.195707 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f9c53cb5-8d6c-4c16-b81f-fe3d2656a1bc tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:05.207284 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f9c53cb5-8d6c-4c16-b81f-fe3d2656a1bc tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:05.208006 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f9c53cb5-8d6c-4c16-b81f-fe3d2656a1bc tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:05.209819 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f9c53cb5-8d6c-4c16-b81f-fe3d2656a1bc tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:05.210625 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f9c53cb5-8d6c-4c16-b81f-fe3d2656a1bc tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:05.365467 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b35f5f5c-45f9-44bb-a0df-e516f2ea8de6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:05.366494 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b35f5f5c-45f9-44bb-a0df-e516f2ea8de6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:05.377866 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b35f5f5c-45f9-44bb-a0df-e516f2ea8de6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:05.378493 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b35f5f5c-45f9-44bb-a0df-e516f2ea8de6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:05.379364 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b35f5f5c-45f9-44bb-a0df-e516f2ea8de6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:05.379829 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b35f5f5c-45f9-44bb-a0df-e516f2ea8de6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:05.467028 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f9c53cb5-8d6c-4c16-b81f-fe3d2656a1bc tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:05.468019 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b35f5f5c-45f9-44bb-a0df-e516f2ea8de6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 20997 microversion: 2.20 time: 0.106017 Nov 24 03:05:05.473626 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 71/165] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:05 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 20997 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 03:05:05.479493 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-82437113-2436-49a9-9b3e-19ed47b011c5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:05.481388 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-82437113-2436-49a9-9b3e-19ed47b011c5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:05.486862 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f9c53cb5-8d6c-4c16-b81f-fe3d2656a1bc tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 200 len: 1508 microversion: 2.1 time: 0.299529 Nov 24 03:05:05.488393 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 95/166] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:05 2021] GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 1508 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:05.499609 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-82437113-2436-49a9-9b3e-19ed47b011c5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:05.500425 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-82437113-2436-49a9-9b3e-19ed47b011c5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:05.513352 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-82437113-2436-49a9-9b3e-19ed47b011c5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:05.514646 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-82437113-2436-49a9-9b3e-19ed47b011c5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:05.520695 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-802469c7-7b2b-4aa9-8af0-f461f66fb3f5 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de29442d-c3cc-4d80-b917-00bdd663868a"}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:05.523810 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-802469c7-7b2b-4aa9-8af0-f461f66fb3f5 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:05.535278 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-802469c7-7b2b-4aa9-8af0-f461f66fb3f5 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:05.536326 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-802469c7-7b2b-4aa9-8af0-f461f66fb3f5 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:05.537907 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-802469c7-7b2b-4aa9-8af0-f461f66fb3f5 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:05.538876 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-802469c7-7b2b-4aa9-8af0-f461f66fb3f5 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:05.802645 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-802469c7-7b2b-4aa9-8af0-f461f66fb3f5 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] HTTP exception thrown: Invalid volume: volume de29442d-c3cc-4d80-b917-00bdd663868a is already attached to instances: 9a175fec-cd0a-49a4-a612-b3698836edef Nov 24 03:05:05.804398 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-802469c7-7b2b-4aa9-8af0-f461f66fb3f5 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Returning 400 to user: Invalid volume: volume de29442d-c3cc-4d80-b917-00bdd663868a is already attached to instances: 9a175fec-cd0a-49a4-a612-b3698836edef {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:05:05.805857 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-802469c7-7b2b-4aa9-8af0-f461f66fb3f5 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "POST /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.294234 Nov 24 03:05:05.822441 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 96/167] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Nov 24 03:05:05 2021] POST /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519/os-volume_attachments => generated 174 bytes in 312 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 24 03:05:05.923890 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-aa9a8319-2e51-46f7-aa70-c2c48b687f7a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:05.925873 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-aa9a8319-2e51-46f7-aa70-c2c48b687f7a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:05.950765 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-aa9a8319-2e51-46f7-aa70-c2c48b687f7a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:05.951875 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-aa9a8319-2e51-46f7-aa70-c2c48b687f7a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:05.956439 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-aa9a8319-2e51-46f7-aa70-c2c48b687f7a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:05.957128 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-aa9a8319-2e51-46f7-aa70-c2c48b687f7a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:06.271314 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-82437113-2436-49a9-9b3e-19ed47b011c5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:06.280634 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-82437113-2436-49a9-9b3e-19ed47b011c5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.805441 Nov 24 03:05:06.285641 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 72/168] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:05 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:06.308049 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.objects.instance [None req-aa9a8319-2e51-46f7-aa70-c2c48b687f7a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lazy-loading 'services' on Instance uuid 9a175fec-cd0a-49a4-a612-b3698836edef {{(pid=116331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:05:06.482637 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-eed04989-63a3-4a3b-9f18-ce12f83be1ac tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:06.485304 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-eed04989-63a3-4a3b-9f18-ce12f83be1ac tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:06.503103 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eed04989-63a3-4a3b-9f18-ce12f83be1ac tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:06.503681 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eed04989-63a3-4a3b-9f18-ce12f83be1ac tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:06.505810 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eed04989-63a3-4a3b-9f18-ce12f83be1ac tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:06.507406 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eed04989-63a3-4a3b-9f18-ce12f83be1ac tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:06.618907 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-eed04989-63a3-4a3b-9f18-ce12f83be1ac tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 22801 microversion: 2.20 time: 0.139196 Nov 24 03:05:06.622141 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 73/169] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:06 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 22801 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 03:05:06.631077 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-aa9a8319-2e51-46f7-aa70-c2c48b687f7a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef/os-volume_attachments/de29442d-c3cc-4d80-b917-00bdd663868a" status: 202 len: 0 microversion: 2.1 time: 0.719080 Nov 24 03:05:06.631715 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 97/170] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Nov 24 03:05:05 2021] DELETE /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef/os-volume_attachments/de29442d-c3cc-4d80-b917-00bdd663868a => generated 0 bytes in 722 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 03:05:06.644269 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-097e6bb1-d67b-43df-be04-e7477d755bee tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:06.646379 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-097e6bb1-d67b-43df-be04-e7477d755bee tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:06.656515 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-097e6bb1-d67b-43df-be04-e7477d755bee tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:06.657340 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-097e6bb1-d67b-43df-be04-e7477d755bee tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:06.659063 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-097e6bb1-d67b-43df-be04-e7477d755bee tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:06.659822 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-097e6bb1-d67b-43df-be04-e7477d755bee tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:06.719132 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-097e6bb1-d67b-43df-be04-e7477d755bee tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080850 Nov 24 03:05:06.720533 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 74/171] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Nov 24 03:05:06 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:05:07.298856 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0937ab95-5ffc-463f-a67e-ee2f84c36fce tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-894836842", "imageRef": "04860a4a-47c3-4532-865d-be6c9c493af7", "flavorRef": "452", "networks": [{"uuid": "922d2004-5882-4bf8-8fc8-00da4513861f"}]}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:07.343188 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5a9cbcb0-4c84-4248-b42a-ab4ed1706b11 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:07.364673 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5a9cbcb0-4c84-4248-b42a-ab4ed1706b11 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:07.403144 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5a9cbcb0-4c84-4248-b42a-ab4ed1706b11 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:07.406760 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5a9cbcb0-4c84-4248-b42a-ab4ed1706b11 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:07.410107 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5a9cbcb0-4c84-4248-b42a-ab4ed1706b11 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:07.412144 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5a9cbcb0-4c84-4248-b42a-ab4ed1706b11 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:07.456001 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.network.neutron [None req-0937ab95-5ffc-463f-a67e-ee2f84c36fce tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] validate_networks() for [('922d2004-5882-4bf8-8fc8-00da4513861f', None, None, None, None, None)] {{(pid=116331) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:05:08.407850 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5a9cbcb0-4c84-4248-b42a-ab4ed1706b11 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:08.433458 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5a9cbcb0-4c84-4248-b42a-ab4ed1706b11 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 1.119508 Nov 24 03:05:08.437389 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 75/172] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:07 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:08.450924 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-245d1765-f80e-4d3b-82ee-5d8a1de8ec56 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:08.453670 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-245d1765-f80e-4d3b-82ee-5d8a1de8ec56 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:08.475385 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-245d1765-f80e-4d3b-82ee-5d8a1de8ec56 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:08.476373 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-245d1765-f80e-4d3b-82ee-5d8a1de8ec56 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:08.477903 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-245d1765-f80e-4d3b-82ee-5d8a1de8ec56 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:08.478621 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-245d1765-f80e-4d3b-82ee-5d8a1de8ec56 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:08.621786 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-0937ab95-5ffc-463f-a67e-ee2f84c36fce tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Flavor limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:05:08.624150 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-0937ab95-5ffc-463f-a67e-ee2f84c36fce tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Image limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:05:08.625253 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-245d1765-f80e-4d3b-82ee-5d8a1de8ec56 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 24786 microversion: 2.20 time: 0.185657 Nov 24 03:05:08.627452 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-0937ab95-5ffc-463f-a67e-ee2f84c36fce tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Flavor pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:05:08.627885 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-0937ab95-5ffc-463f-a67e-ee2f84c36fce tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Image pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:05:08.628686 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 76/173] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:08 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 24786 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:08.629298 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-0937ab95-5ffc-463f-a67e-ee2f84c36fce tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:05:08.639445 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2c2819b9-bce3-43f9-85e8-f1f7c27d6bb1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:08.647700 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2c2819b9-bce3-43f9-85e8-f1f7c27d6bb1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:08.655864 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0937ab95-5ffc-463f-a67e-ee2f84c36fce tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:08.660664 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0937ab95-5ffc-463f-a67e-ee2f84c36fce tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:08.666048 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0937ab95-5ffc-463f-a67e-ee2f84c36fce tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:08.668402 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0937ab95-5ffc-463f-a67e-ee2f84c36fce tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:08.680805 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2c2819b9-bce3-43f9-85e8-f1f7c27d6bb1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:08.681683 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2c2819b9-bce3-43f9-85e8-f1f7c27d6bb1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:08.682792 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2c2819b9-bce3-43f9-85e8-f1f7c27d6bb1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:08.687273 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2c2819b9-bce3-43f9-85e8-f1f7c27d6bb1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:08.747977 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-0937ab95-5ffc-463f-a67e-ee2f84c36fce tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Getting quotas for project 1168b5e9cbf2481b87e2941d66cc41e4. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:05:08.787706 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-0937ab95-5ffc-463f-a67e-ee2f84c36fce tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Getting quotas for user 707b4994da624c5b8e3297fb747abd09 and project 1168b5e9cbf2481b87e2941d66cc41e4. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:05:08.790683 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2c2819b9-bce3-43f9-85e8-f1f7c27d6bb1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.159656 Nov 24 03:05:08.791414 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 77/174] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Nov 24 03:05:08 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef/os-volume_attachments => generated 25 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:05:08.860095 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0937ab95-5ffc-463f-a67e-ee2f84c36fce tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Going to run 1 instances... {{(pid=116331) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:05:08.881889 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0937ab95-5ffc-463f-a67e-ee2f84c36fce tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04860a4a-47c3-4532-865d-be6c9c493af7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:05:09.054312 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0937ab95-5ffc-463f-a67e-ee2f84c36fce tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.760866 Nov 24 03:05:09.055949 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 98/175] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Nov 24 03:05:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 1764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 03:05:09.069584 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5885d602-e390-4219-9ce5-1d02d7d11b90 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:09.070499 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5885d602-e390-4219-9ce5-1d02d7d11b90 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:09.092764 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-aacc8725-4485-4613-b9d3-ec5685152b29 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-957706557", "imageRef": "04860a4a-47c3-4532-865d-be6c9c493af7", "flavorRef": "452", "networks": [{"uuid": "3f10594b-6f86-48fa-a7b0-505b247d8265"}]}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:09.245682 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.network.neutron [None req-aacc8725-4485-4613-b9d3-ec5685152b29 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] validate_networks() for [('3f10594b-6f86-48fa-a7b0-505b247d8265', None, None, None, None, None)] {{(pid=116331) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:05:09.346477 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5885d602-e390-4219-9ce5-1d02d7d11b90 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:09.359838 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5885d602-e390-4219-9ce5-1d02d7d11b90 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 200 len: 1213 microversion: 2.1 time: 0.293922 Nov 24 03:05:09.370694 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 78/176] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:09 2021] GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 1213 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:05:09.459126 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-79aaff73-b445-4094-a4d8-5d02625e4de7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:09.459845 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-79aaff73-b445-4094-a4d8-5d02625e4de7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:09.476794 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79aaff73-b445-4094-a4d8-5d02625e4de7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:09.478484 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79aaff73-b445-4094-a4d8-5d02625e4de7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:09.484175 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79aaff73-b445-4094-a4d8-5d02625e4de7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:09.485666 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79aaff73-b445-4094-a4d8-5d02625e4de7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:09.980764 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-79aaff73-b445-4094-a4d8-5d02625e4de7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:09.994757 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-79aaff73-b445-4094-a4d8-5d02625e4de7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.542046 Nov 24 03:05:09.996835 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 79/177] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:09 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:10.002483 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0bcd5560-dc49-4a17-807c-67e084d2f086 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:10.003912 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0bcd5560-dc49-4a17-807c-67e084d2f086 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:10.011554 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0bcd5560-dc49-4a17-807c-67e084d2f086 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:10.012451 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0bcd5560-dc49-4a17-807c-67e084d2f086 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:10.013586 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0bcd5560-dc49-4a17-807c-67e084d2f086 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:10.014396 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0bcd5560-dc49-4a17-807c-67e084d2f086 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:10.117458 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-aacc8725-4485-4613-b9d3-ec5685152b29 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Flavor limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:05:10.118298 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-aacc8725-4485-4613-b9d3-ec5685152b29 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Image limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:05:10.119169 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-aacc8725-4485-4613-b9d3-ec5685152b29 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Flavor pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:05:10.119892 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-aacc8725-4485-4613-b9d3-ec5685152b29 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Image pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:05:10.120631 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-aacc8725-4485-4613-b9d3-ec5685152b29 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:05:10.150632 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-aacc8725-4485-4613-b9d3-ec5685152b29 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:10.151429 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-aacc8725-4485-4613-b9d3-ec5685152b29 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:10.152942 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0bcd5560-dc49-4a17-807c-67e084d2f086 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 26378 microversion: 2.20 time: 0.154571 Nov 24 03:05:10.153896 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 80/178] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:09 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 26378 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:10.161610 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-aacc8725-4485-4613-b9d3-ec5685152b29 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:10.163381 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-aacc8725-4485-4613-b9d3-ec5685152b29 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:10.204962 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-aacc8725-4485-4613-b9d3-ec5685152b29 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Getting quotas for project 0d8250c30ab9492ab167e4dd03c96be1. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:05:10.226046 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-aacc8725-4485-4613-b9d3-ec5685152b29 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Getting quotas for user 7721d1277c63459dacf166e44cacf3b5 and project 0d8250c30ab9492ab167e4dd03c96be1. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:05:10.244605 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-aacc8725-4485-4613-b9d3-ec5685152b29 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Going to run 1 instances... {{(pid=116331) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:05:10.248552 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-aacc8725-4485-4613-b9d3-ec5685152b29 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04860a4a-47c3-4532-865d-be6c9c493af7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:05:10.310899 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-aacc8725-4485-4613-b9d3-ec5685152b29 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.221967 Nov 24 03:05:10.320398 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 99/179] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Nov 24 03:05:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 03:05:10.324346 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5fe93a01-072e-4423-b6f1-092c8697b489 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:10.326028 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5fe93a01-072e-4423-b6f1-092c8697b489 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:10.377130 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-968dbaba-d9f5-4b1a-8fa1-50577e4bb896 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:10.378109 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-968dbaba-d9f5-4b1a-8fa1-50577e4bb896 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:10.389309 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-968dbaba-d9f5-4b1a-8fa1-50577e4bb896 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:10.390109 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-968dbaba-d9f5-4b1a-8fa1-50577e4bb896 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:10.391121 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-968dbaba-d9f5-4b1a-8fa1-50577e4bb896 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:10.391883 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-968dbaba-d9f5-4b1a-8fa1-50577e4bb896 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:10.580275 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-968dbaba-d9f5-4b1a-8fa1-50577e4bb896 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:10.619657 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5fe93a01-072e-4423-b6f1-092c8697b489 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:10.622542 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-968dbaba-d9f5-4b1a-8fa1-50577e4bb896 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 200 len: 1209 microversion: 2.1 time: 0.246223 Nov 24 03:05:10.625558 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 100/180] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:10 2021] GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 1209 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:05:10.651415 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5fe93a01-072e-4423-b6f1-092c8697b489 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 200 len: 1217 microversion: 2.1 time: 0.329686 Nov 24 03:05:10.652507 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 81/181] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:10 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 1217 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:11.023994 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ad2296e5-fc36-4529-8067-b36bbf4a9e89 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:11.024611 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ad2296e5-fc36-4529-8067-b36bbf4a9e89 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:11.034649 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ad2296e5-fc36-4529-8067-b36bbf4a9e89 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:11.035427 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ad2296e5-fc36-4529-8067-b36bbf4a9e89 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:11.040256 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ad2296e5-fc36-4529-8067-b36bbf4a9e89 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:11.040985 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ad2296e5-fc36-4529-8067-b36bbf4a9e89 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:11.171579 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-761bc075-f71c-4faa-97a2-c1c941cb35a1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:11.173789 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-761bc075-f71c-4faa-97a2-c1c941cb35a1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:11.205836 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-761bc075-f71c-4faa-97a2-c1c941cb35a1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:11.207515 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-761bc075-f71c-4faa-97a2-c1c941cb35a1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:11.210050 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-761bc075-f71c-4faa-97a2-c1c941cb35a1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:11.212040 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-761bc075-f71c-4faa-97a2-c1c941cb35a1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:11.388748 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-761bc075-f71c-4faa-97a2-c1c941cb35a1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 27159 microversion: 2.20 time: 0.222573 Nov 24 03:05:11.400009 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 82/182] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:11 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 27159 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 03:05:11.644429 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-64e455cf-4062-49d8-bb56-d937007f0972 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:11.646311 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-64e455cf-4062-49d8-bb56-d937007f0972 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:11.660229 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-64e455cf-4062-49d8-bb56-d937007f0972 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:11.663188 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-64e455cf-4062-49d8-bb56-d937007f0972 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:11.667314 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-64e455cf-4062-49d8-bb56-d937007f0972 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:11.670973 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-64e455cf-4062-49d8-bb56-d937007f0972 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:11.822926 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-64e455cf-4062-49d8-bb56-d937007f0972 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:11.843450 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-64e455cf-4062-49d8-bb56-d937007f0972 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 200 len: 1271 microversion: 2.1 time: 0.202287 Nov 24 03:05:11.846309 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 83/183] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:11 2021] GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 1271 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:05:11.883326 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5bd57c5e-fdb0-423a-b16b-2f6aa4c0fae0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:11.885455 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5bd57c5e-fdb0-423a-b16b-2f6aa4c0fae0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:11.919712 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ad2296e5-fc36-4529-8067-b36bbf4a9e89 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:11.920722 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5bd57c5e-fdb0-423a-b16b-2f6aa4c0fae0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:11.921447 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5bd57c5e-fdb0-423a-b16b-2f6aa4c0fae0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:11.924309 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5bd57c5e-fdb0-423a-b16b-2f6aa4c0fae0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:11.925775 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5bd57c5e-fdb0-423a-b16b-2f6aa4c0fae0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:11.951170 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ad2296e5-fc36-4529-8067-b36bbf4a9e89 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.929230 Nov 24 03:05:11.970400 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 101/184] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:11 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:12.119852 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5bd57c5e-fdb0-423a-b16b-2f6aa4c0fae0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:12.165199 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5bd57c5e-fdb0-423a-b16b-2f6aa4c0fae0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 200 len: 1269 microversion: 2.1 time: 0.316875 Nov 24 03:05:12.173292 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 84/185] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:11 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 1269 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:12.418780 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-8fd8da46-2c06-4c71-be99-70db3f2320e6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:12.433853 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-8fd8da46-2c06-4c71-be99-70db3f2320e6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:12.484655 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8fd8da46-2c06-4c71-be99-70db3f2320e6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:12.486218 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8fd8da46-2c06-4c71-be99-70db3f2320e6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:12.487186 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8fd8da46-2c06-4c71-be99-70db3f2320e6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:12.487534 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8fd8da46-2c06-4c71-be99-70db3f2320e6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:12.641862 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-8fd8da46-2c06-4c71-be99-70db3f2320e6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 27711 microversion: 2.20 time: 0.230780 Nov 24 03:05:12.644212 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 102/186] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:12 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 27711 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:12.887918 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a6454ddc-dd12-48f3-bccc-108a7553b953 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:12.890145 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a6454ddc-dd12-48f3-bccc-108a7553b953 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:12.938478 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a6454ddc-dd12-48f3-bccc-108a7553b953 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:12.940554 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a6454ddc-dd12-48f3-bccc-108a7553b953 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:12.965327 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a6454ddc-dd12-48f3-bccc-108a7553b953 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:12.966024 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a6454ddc-dd12-48f3-bccc-108a7553b953 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:12.983207 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-13b1e888-26cf-43e7-8368-816eecefe675 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:12.984010 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-13b1e888-26cf-43e7-8368-816eecefe675 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:13.007646 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-13b1e888-26cf-43e7-8368-816eecefe675 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:13.008171 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-13b1e888-26cf-43e7-8368-816eecefe675 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:13.008910 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-13b1e888-26cf-43e7-8368-816eecefe675 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:13.009356 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-13b1e888-26cf-43e7-8368-816eecefe675 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:13.402446 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-13b1e888-26cf-43e7-8368-816eecefe675 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:13.429741 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-13b1e888-26cf-43e7-8368-816eecefe675 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.450331 Nov 24 03:05:13.430759 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 103/187] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:12 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:05:13.455709 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-1ff84d8b-2808-42c8-bf8d-c2fc4fb07cd4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:13.459793 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-1ff84d8b-2808-42c8-bf8d-c2fc4fb07cd4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:13.481520 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1ff84d8b-2808-42c8-bf8d-c2fc4fb07cd4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:13.486967 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1ff84d8b-2808-42c8-bf8d-c2fc4fb07cd4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:13.488957 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1ff84d8b-2808-42c8-bf8d-c2fc4fb07cd4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:13.489983 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1ff84d8b-2808-42c8-bf8d-c2fc4fb07cd4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:13.650725 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-1ff84d8b-2808-42c8-bf8d-c2fc4fb07cd4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:13.673107 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-1ff84d8b-2808-42c8-bf8d-c2fc4fb07cd4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 200 len: 1275 microversion: 2.1 time: 0.234185 Nov 24 03:05:13.675569 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 104/188] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:13 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 1275 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:13.710733 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-37ef7b7a-77e9-4d65-ace6-e4d1c5e65ed4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:13.712516 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-37ef7b7a-77e9-4d65-ace6-e4d1c5e65ed4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:13.723759 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-37ef7b7a-77e9-4d65-ace6-e4d1c5e65ed4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:13.724645 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-37ef7b7a-77e9-4d65-ace6-e4d1c5e65ed4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:13.726268 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-37ef7b7a-77e9-4d65-ace6-e4d1c5e65ed4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:13.727135 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-37ef7b7a-77e9-4d65-ace6-e4d1c5e65ed4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:13.873145 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-37ef7b7a-77e9-4d65-ace6-e4d1c5e65ed4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 27982 microversion: 2.20 time: 0.176239 Nov 24 03:05:13.874347 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 105/189] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:13 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 27982 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:14.319749 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a6454ddc-dd12-48f3-bccc-108a7553b953 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:14.350903 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a6454ddc-dd12-48f3-bccc-108a7553b953 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 200 len: 1313 microversion: 2.1 time: 1.482199 Nov 24 03:05:14.362491 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 85/190] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:12 2021] GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 1313 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:14.455260 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c089f661-71d7-46b7-8e48-f6e19b0a3d8e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:14.456876 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c089f661-71d7-46b7-8e48-f6e19b0a3d8e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:14.484181 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c089f661-71d7-46b7-8e48-f6e19b0a3d8e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:14.491163 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c089f661-71d7-46b7-8e48-f6e19b0a3d8e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:14.492782 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c089f661-71d7-46b7-8e48-f6e19b0a3d8e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:14.493568 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c089f661-71d7-46b7-8e48-f6e19b0a3d8e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:14.705547 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-912599f5-07b2-475a-9d8b-7ca958e50b43 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:14.706259 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-912599f5-07b2-475a-9d8b-7ca958e50b43 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:14.717103 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-912599f5-07b2-475a-9d8b-7ca958e50b43 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:14.717552 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-912599f5-07b2-475a-9d8b-7ca958e50b43 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:14.733476 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-912599f5-07b2-475a-9d8b-7ca958e50b43 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:14.733476 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-912599f5-07b2-475a-9d8b-7ca958e50b43 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:15.087216 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c089f661-71d7-46b7-8e48-f6e19b0a3d8e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:15.114037 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c089f661-71d7-46b7-8e48-f6e19b0a3d8e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.667851 Nov 24 03:05:15.124912 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 106/191] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:14 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:15.147571 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4592c0df-7b5a-480f-8c0a-794026549b1e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:15.168464 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4592c0df-7b5a-480f-8c0a-794026549b1e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:15.179151 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4592c0df-7b5a-480f-8c0a-794026549b1e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:15.179994 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4592c0df-7b5a-480f-8c0a-794026549b1e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:15.181288 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4592c0df-7b5a-480f-8c0a-794026549b1e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:15.182320 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4592c0df-7b5a-480f-8c0a-794026549b1e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:15.352129 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4592c0df-7b5a-480f-8c0a-794026549b1e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 28220 microversion: 2.20 time: 0.224864 Nov 24 03:05:15.353758 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 107/192] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:15 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 28220 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:15.385222 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4f41e1b4-76df-48d7-a9c0-0b1e71b75e57 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:15.388060 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4f41e1b4-76df-48d7-a9c0-0b1e71b75e57 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:15.413344 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4f41e1b4-76df-48d7-a9c0-0b1e71b75e57 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:15.418044 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4f41e1b4-76df-48d7-a9c0-0b1e71b75e57 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:15.419250 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4f41e1b4-76df-48d7-a9c0-0b1e71b75e57 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:15.419816 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4f41e1b4-76df-48d7-a9c0-0b1e71b75e57 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:15.969438 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-912599f5-07b2-475a-9d8b-7ca958e50b43 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:16.000434 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-912599f5-07b2-475a-9d8b-7ca958e50b43 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 200 len: 1317 microversion: 2.1 time: 1.298614 Nov 24 03:05:16.002990 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 86/193] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:14 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 1317 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:16.018867 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4f41e1b4-76df-48d7-a9c0-0b1e71b75e57 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:16.024917 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-b0247f72-38cf-4afe-876a-dd732f1ff7e0 req-d3d91244-7ca6-4da5-827c-91c8191cfb19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41", "tag": "b33d4a02-2fae-4346-aa95-aaabcd7a9bb4"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:16.027035 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:05:16.027035 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:05:16.030876 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4f41e1b4-76df-48d7-a9c0-0b1e71b75e57 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 200 len: 1313 microversion: 2.1 time: 0.653600 Nov 24 03:05:16.042697 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-b0247f72-38cf-4afe-876a-dd732f1ff7e0 req-d3d91244-7ca6-4da5-827c-91c8191cfb19 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:16.043349 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-b0247f72-38cf-4afe-876a-dd732f1ff7e0 req-d3d91244-7ca6-4da5-827c-91c8191cfb19 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:16.043954 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 108/194] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:15 2021] GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 1313 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:16.071363 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-b0247f72-38cf-4afe-876a-dd732f1ff7e0 req-d3d91244-7ca6-4da5-827c-91c8191cfb19 service nova] Creating event network-changed:b33d4a02-2fae-4346-aa95-aaabcd7a9bb4 for instance 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 on hv-cinder-81803 Nov 24 03:05:16.106745 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-b0247f72-38cf-4afe-876a-dd732f1ff7e0 req-d3d91244-7ca6-4da5-827c-91c8191cfb19 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085531 Nov 24 03:05:16.108115 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 87/195] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:05:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:05:16.149723 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-9070c108-0624-43b4-aa6b-2de364dcf4a3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:16.150677 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-9070c108-0624-43b4-aa6b-2de364dcf4a3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:16.163044 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9070c108-0624-43b4-aa6b-2de364dcf4a3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:16.165176 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9070c108-0624-43b4-aa6b-2de364dcf4a3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:16.166606 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9070c108-0624-43b4-aa6b-2de364dcf4a3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:16.167853 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9070c108-0624-43b4-aa6b-2de364dcf4a3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:16.370075 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-52fedf4c-e121-4930-ad13-0980a84bac74 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:16.381175 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-52fedf4c-e121-4930-ad13-0980a84bac74 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:16.398032 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-52fedf4c-e121-4930-ad13-0980a84bac74 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:16.398784 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-52fedf4c-e121-4930-ad13-0980a84bac74 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:16.399857 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-52fedf4c-e121-4930-ad13-0980a84bac74 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:16.400657 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-52fedf4c-e121-4930-ad13-0980a84bac74 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:16.506817 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-52fedf4c-e121-4930-ad13-0980a84bac74 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 28235 microversion: 2.20 time: 0.140757 Nov 24 03:05:16.508421 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 88/196] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:16 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 28235 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:16.728853 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-9070c108-0624-43b4-aa6b-2de364dcf4a3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:16.740954 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-9070c108-0624-43b4-aa6b-2de364dcf4a3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.595440 Nov 24 03:05:16.745740 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 109/197] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:16 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:17.035289 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ff1abd90-ee75-4bb9-9a84-5072296e18c1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:17.036006 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ff1abd90-ee75-4bb9-9a84-5072296e18c1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:17.052687 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e0bdb4ac-2daf-4e89-9c95-773889f96b0d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:17.054276 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e0bdb4ac-2daf-4e89-9c95-773889f96b0d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:17.068862 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e0bdb4ac-2daf-4e89-9c95-773889f96b0d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:17.069407 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e0bdb4ac-2daf-4e89-9c95-773889f96b0d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:17.070315 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e0bdb4ac-2daf-4e89-9c95-773889f96b0d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:17.070767 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e0bdb4ac-2daf-4e89-9c95-773889f96b0d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:17.077195 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff1abd90-ee75-4bb9-9a84-5072296e18c1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:17.077658 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff1abd90-ee75-4bb9-9a84-5072296e18c1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:17.078507 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff1abd90-ee75-4bb9-9a84-5072296e18c1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:17.079090 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff1abd90-ee75-4bb9-9a84-5072296e18c1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:17.523630 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e0bdb4ac-2daf-4e89-9c95-773889f96b0d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:17.532127 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e0bdb4ac-2daf-4e89-9c95-773889f96b0d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 200 len: 1313 microversion: 2.1 time: 0.485678 Nov 24 03:05:17.539090 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 110/198] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:17 2021] GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:05:17.561969 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-3b21e4b2-c96e-432c-95ff-714404fc5bd7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:17.570697 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-3b21e4b2-c96e-432c-95ff-714404fc5bd7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:17.612140 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3b21e4b2-c96e-432c-95ff-714404fc5bd7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:17.614745 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3b21e4b2-c96e-432c-95ff-714404fc5bd7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:17.616761 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3b21e4b2-c96e-432c-95ff-714404fc5bd7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:17.617810 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3b21e4b2-c96e-432c-95ff-714404fc5bd7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:17.786814 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-3b21e4b2-c96e-432c-95ff-714404fc5bd7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 28510 microversion: 2.20 time: 0.243499 Nov 24 03:05:17.787591 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 111/199] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:17 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 28510 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:17.814666 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-beeeba59-0ea2-422f-b00b-52f2d8f6d47e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:17.815456 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-beeeba59-0ea2-422f-b00b-52f2d8f6d47e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:17.858891 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-beeeba59-0ea2-422f-b00b-52f2d8f6d47e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:17.859874 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-beeeba59-0ea2-422f-b00b-52f2d8f6d47e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:17.862401 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-beeeba59-0ea2-422f-b00b-52f2d8f6d47e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:17.863624 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-beeeba59-0ea2-422f-b00b-52f2d8f6d47e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:18.010846 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ff1abd90-ee75-4bb9-9a84-5072296e18c1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:18.032347 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ff1abd90-ee75-4bb9-9a84-5072296e18c1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 200 len: 1317 microversion: 2.1 time: 1.004297 Nov 24 03:05:18.039616 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 89/200] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:17 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 1317 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:18.271366 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-beeeba59-0ea2-422f-b00b-52f2d8f6d47e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:18.283856 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-beeeba59-0ea2-422f-b00b-52f2d8f6d47e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.482817 Nov 24 03:05:18.294637 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 112/201] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:17 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:18.479770 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-1f56179f-9834-4b32-bd3e-953a7ca5f002 req-95944dc6-7179-4568-b0e9-1dba748aeafd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d57fe44d-e7d6-4188-b8aa-343ca2963f68", "tag": "0369e643-d459-41b8-9f2d-380b361c90bf"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:18.481672 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:05:18.481672 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:05:18.507918 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-1f56179f-9834-4b32-bd3e-953a7ca5f002 req-95944dc6-7179-4568-b0e9-1dba748aeafd service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:18.508984 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-1f56179f-9834-4b32-bd3e-953a7ca5f002 req-95944dc6-7179-4568-b0e9-1dba748aeafd service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:18.538465 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-1f56179f-9834-4b32-bd3e-953a7ca5f002 req-95944dc6-7179-4568-b0e9-1dba748aeafd service nova] Creating event network-changed:0369e643-d459-41b8-9f2d-380b361c90bf for instance d57fe44d-e7d6-4188-b8aa-343ca2963f68 on hv-cinder-81803 Nov 24 03:05:18.550618 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-1f56179f-9834-4b32-bd3e-953a7ca5f002 req-95944dc6-7179-4568-b0e9-1dba748aeafd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075945 Nov 24 03:05:18.553465 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 90/202] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:05:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:05:18.568388 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7000bf81-6573-4f50-bd70-c3b12b97750c tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:18.571976 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-7000bf81-6573-4f50-bd70-c3b12b97750c tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:18.586938 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7000bf81-6573-4f50-bd70-c3b12b97750c tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:18.588238 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7000bf81-6573-4f50-bd70-c3b12b97750c tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:18.590063 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7000bf81-6573-4f50-bd70-c3b12b97750c tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:18.591285 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7000bf81-6573-4f50-bd70-c3b12b97750c tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:18.807091 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ffbeadb2-66d3-4a51-b392-a63090628af1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:18.808933 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ffbeadb2-66d3-4a51-b392-a63090628af1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:18.835141 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ffbeadb2-66d3-4a51-b392-a63090628af1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:18.835827 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ffbeadb2-66d3-4a51-b392-a63090628af1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:18.837082 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ffbeadb2-66d3-4a51-b392-a63090628af1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:18.863956 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ffbeadb2-66d3-4a51-b392-a63090628af1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:19.001197 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7000bf81-6573-4f50-bd70-c3b12b97750c tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:19.012796 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7000bf81-6573-4f50-bd70-c3b12b97750c tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 200 len: 1313 microversion: 2.1 time: 0.451459 Nov 24 03:05:19.031017 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 113/203] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:18 2021] GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:19.056431 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-04e13856-ab03-4693-9d29-8eaec7850a41 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:19.057087 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-04e13856-ab03-4693-9d29-8eaec7850a41 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:19.073907 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-04e13856-ab03-4693-9d29-8eaec7850a41 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:19.074314 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-04e13856-ab03-4693-9d29-8eaec7850a41 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:19.075396 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-04e13856-ab03-4693-9d29-8eaec7850a41 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:19.075832 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-04e13856-ab03-4693-9d29-8eaec7850a41 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:19.473449 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-04e13856-ab03-4693-9d29-8eaec7850a41 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:19.484080 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-04e13856-ab03-4693-9d29-8eaec7850a41 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 200 len: 1317 microversion: 2.1 time: 0.431547 Nov 24 03:05:19.485964 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 114/204] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:19 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 1317 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:05:19.491321 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2ec1ee3b-0607-4146-be71-b0d74e165327 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:19.492298 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2ec1ee3b-0607-4146-be71-b0d74e165327 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:19.499973 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ec1ee3b-0607-4146-be71-b0d74e165327 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:19.502499 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ec1ee3b-0607-4146-be71-b0d74e165327 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:19.503739 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ec1ee3b-0607-4146-be71-b0d74e165327 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:19.504255 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ec1ee3b-0607-4146-be71-b0d74e165327 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:19.704822 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2ec1ee3b-0607-4146-be71-b0d74e165327 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:19.709271 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2ec1ee3b-0607-4146-be71-b0d74e165327 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.221211 Nov 24 03:05:19.715661 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 115/205] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:19 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:19.879180 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-49442bcd-dcaf-441a-b459-e095a8dbaff8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'create', calling method: .version_select at 0x7f7a2ea91670>, body: {"keypair": {"name": "tempest-keypair-526221247"}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:19.903000 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-49442bcd-dcaf-441a-b459-e095a8dbaff8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Getting quotas for project 1368b90b7cae4e3d936fcd3a97893dc3. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:05:19.911710 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-49442bcd-dcaf-441a-b459-e095a8dbaff8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Getting quotas for user 22bd0f1d66884b66945eec4ede0aea0d and project 1368b90b7cae4e3d936fcd3a97893dc3. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:05:20.255531 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-49442bcd-dcaf-441a-b459-e095a8dbaff8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Getting quotas for project 1368b90b7cae4e3d936fcd3a97893dc3. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:05:20.261489 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-49442bcd-dcaf-441a-b459-e095a8dbaff8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Getting quotas for user 22bd0f1d66884b66945eec4ede0aea0d and project 1368b90b7cae4e3d936fcd3a97893dc3. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:05:20.286595 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-49442bcd-dcaf-441a-b459-e095a8dbaff8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.569080 Nov 24 03:05:20.289096 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 116/206] 10.222.0.52 () {60 vars in 1157 bytes} [Wed Nov 24 03:05:19 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:20.303723 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c2be881b-71f0-4d48-a0ac-ed9d91bee4ad tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:20.304461 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c2be881b-71f0-4d48-a0ac-ed9d91bee4ad tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:20.311749 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c2be881b-71f0-4d48-a0ac-ed9d91bee4ad tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:20.312194 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c2be881b-71f0-4d48-a0ac-ed9d91bee4ad tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:20.313338 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c2be881b-71f0-4d48-a0ac-ed9d91bee4ad tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:20.314087 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c2be881b-71f0-4d48-a0ac-ed9d91bee4ad tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:20.547081 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c2be881b-71f0-4d48-a0ac-ed9d91bee4ad tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:20.560999 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c2be881b-71f0-4d48-a0ac-ed9d91bee4ad tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 200 len: 1313 microversion: 2.1 time: 0.265519 Nov 24 03:05:20.563629 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 117/207] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:20 2021] GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:20.571238 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2f9b2070-9e9a-443d-a31d-86dd93eae689 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:20.572240 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2f9b2070-9e9a-443d-a31d-86dd93eae689 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:20.580673 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2f9b2070-9e9a-443d-a31d-86dd93eae689 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:20.581554 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2f9b2070-9e9a-443d-a31d-86dd93eae689 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:20.582917 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2f9b2070-9e9a-443d-a31d-86dd93eae689 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:20.583538 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2f9b2070-9e9a-443d-a31d-86dd93eae689 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:20.789662 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2f9b2070-9e9a-443d-a31d-86dd93eae689 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:20.804595 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2f9b2070-9e9a-443d-a31d-86dd93eae689 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 200 len: 1317 microversion: 2.1 time: 0.239430 Nov 24 03:05:20.805642 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 118/208] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:20 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:20.812113 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-22e9a0ea-f90e-40ad-8dde-2f729a151a18 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:20.812113 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-22e9a0ea-f90e-40ad-8dde-2f729a151a18 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:20.818875 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-22e9a0ea-f90e-40ad-8dde-2f729a151a18 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:20.819340 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-22e9a0ea-f90e-40ad-8dde-2f729a151a18 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:20.820615 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-22e9a0ea-f90e-40ad-8dde-2f729a151a18 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:20.821118 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-22e9a0ea-f90e-40ad-8dde-2f729a151a18 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:21.090721 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-22e9a0ea-f90e-40ad-8dde-2f729a151a18 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:21.099880 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-22e9a0ea-f90e-40ad-8dde-2f729a151a18 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.293039 Nov 24 03:05:21.102084 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 119/209] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:20 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:21.344735 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ffbeadb2-66d3-4a51-b392-a63090628af1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 28677 microversion: 2.20 time: 2.545870 Nov 24 03:05:21.346109 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 91/210] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:18 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 28677 bytes in 2550 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:21.581274 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ae90e1ce-8141-4506-af41-c767c2662e26 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:21.581903 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ae90e1ce-8141-4506-af41-c767c2662e26 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:21.589607 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ae90e1ce-8141-4506-af41-c767c2662e26 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:21.590106 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ae90e1ce-8141-4506-af41-c767c2662e26 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:21.590927 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ae90e1ce-8141-4506-af41-c767c2662e26 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:21.591375 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ae90e1ce-8141-4506-af41-c767c2662e26 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:21.826117 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3bf723b8-cb54-4f54-bf14-acd73c3d473e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:21.826937 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3bf723b8-cb54-4f54-bf14-acd73c3d473e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:21.844522 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ae90e1ce-8141-4506-af41-c767c2662e26 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:21.845492 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3bf723b8-cb54-4f54-bf14-acd73c3d473e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:21.846947 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3bf723b8-cb54-4f54-bf14-acd73c3d473e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:21.848004 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3bf723b8-cb54-4f54-bf14-acd73c3d473e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:21.848711 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3bf723b8-cb54-4f54-bf14-acd73c3d473e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:21.864010 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ae90e1ce-8141-4506-af41-c767c2662e26 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 200 len: 1313 microversion: 2.1 time: 0.286623 Nov 24 03:05:21.865939 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 120/211] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:21 2021] GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:22.121079 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-86df04df-33c0-406d-a9a2-6648e17c3307 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:22.122449 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-86df04df-33c0-406d-a9a2-6648e17c3307 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:22.141317 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-86df04df-33c0-406d-a9a2-6648e17c3307 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:22.142641 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-86df04df-33c0-406d-a9a2-6648e17c3307 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:22.144697 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-86df04df-33c0-406d-a9a2-6648e17c3307 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:22.145831 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-86df04df-33c0-406d-a9a2-6648e17c3307 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:22.471446 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-86df04df-33c0-406d-a9a2-6648e17c3307 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:22.481373 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-86df04df-33c0-406d-a9a2-6648e17c3307 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.366965 Nov 24 03:05:22.482360 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 121/212] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:22 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:22.497255 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5413da1a-4652-40d8-833c-3654998d1aa9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:22.500784 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-5413da1a-4652-40d8-833c-3654998d1aa9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:22.519585 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5413da1a-4652-40d8-833c-3654998d1aa9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:22.521863 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5413da1a-4652-40d8-833c-3654998d1aa9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:22.523827 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5413da1a-4652-40d8-833c-3654998d1aa9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:22.527346 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5413da1a-4652-40d8-833c-3654998d1aa9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:22.544927 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3bf723b8-cb54-4f54-bf14-acd73c3d473e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:22.559179 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3bf723b8-cb54-4f54-bf14-acd73c3d473e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 200 len: 1317 microversion: 2.1 time: 0.734290 Nov 24 03:05:22.571942 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 92/213] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:21 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 1317 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:22.643681 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-5413da1a-4652-40d8-833c-3654998d1aa9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 28677 microversion: 2.20 time: 0.159161 Nov 24 03:05:22.644224 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 122/214] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:22 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 28677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:22.887446 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2d9f3d2b-7793-41cc-b01f-e78ef0205eea tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:22.888336 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2d9f3d2b-7793-41cc-b01f-e78ef0205eea tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:22.898641 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d9f3d2b-7793-41cc-b01f-e78ef0205eea tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:22.899069 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d9f3d2b-7793-41cc-b01f-e78ef0205eea tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:22.900172 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d9f3d2b-7793-41cc-b01f-e78ef0205eea tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:22.900790 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d9f3d2b-7793-41cc-b01f-e78ef0205eea tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:23.501080 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-9f303627-e6b2-4214-b210-0692a01c4d27 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:23.501803 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-9f303627-e6b2-4214-b210-0692a01c4d27 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:23.514719 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9f303627-e6b2-4214-b210-0692a01c4d27 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:23.515398 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9f303627-e6b2-4214-b210-0692a01c4d27 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:23.516539 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9f303627-e6b2-4214-b210-0692a01c4d27 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:23.517077 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9f303627-e6b2-4214-b210-0692a01c4d27 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:23.788204 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2d9f3d2b-7793-41cc-b01f-e78ef0205eea tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:23.803507 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2d9f3d2b-7793-41cc-b01f-e78ef0205eea tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 200 len: 1313 microversion: 2.1 time: 0.923368 Nov 24 03:05:23.807990 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-9f303627-e6b2-4214-b210-0692a01c4d27 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:23.825041 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-9f303627-e6b2-4214-b210-0692a01c4d27 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1522 microversion: 2.1 time: 0.322549 Nov 24 03:05:23.827106 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 123/216] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:23 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:05:23.829945 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 93/216] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:22 2021] GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 1313 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:23.847675 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0c3c7ca2-4298-472e-803e-07bd93f8a0dd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:23.849353 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0c3c7ca2-4298-472e-803e-07bd93f8a0dd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:23.869717 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-d92f521e-b66e-4cd6-b1e3-1e6b4006ce90 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:23.873344 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-d92f521e-b66e-4cd6-b1e3-1e6b4006ce90 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:23.883019 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c3c7ca2-4298-472e-803e-07bd93f8a0dd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:23.883558 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c3c7ca2-4298-472e-803e-07bd93f8a0dd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:23.884438 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c3c7ca2-4298-472e-803e-07bd93f8a0dd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:23.884880 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c3c7ca2-4298-472e-803e-07bd93f8a0dd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:23.895862 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d92f521e-b66e-4cd6-b1e3-1e6b4006ce90 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:23.897198 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d92f521e-b66e-4cd6-b1e3-1e6b4006ce90 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:23.899081 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d92f521e-b66e-4cd6-b1e3-1e6b4006ce90 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:23.900210 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d92f521e-b66e-4cd6-b1e3-1e6b4006ce90 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:24.010333 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0c3c7ca2-4298-472e-803e-07bd93f8a0dd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 28677 microversion: 2.20 time: 0.178115 Nov 24 03:05:24.011648 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 94/217] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:23 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 28677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:24.227794 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-d92f521e-b66e-4cd6-b1e3-1e6b4006ce90 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:24.239160 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-d92f521e-b66e-4cd6-b1e3-1e6b4006ce90 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 200 len: 1317 microversion: 2.1 time: 0.410520 Nov 24 03:05:24.250557 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 124/218] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:23 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:24.843647 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e2f34d38-ad6a-469b-85ed-618d2877366e tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:24.858874 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2af48bcd-9433-40c9-aa24-23a0c0f68ada tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:24.861664 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e2f34d38-ad6a-469b-85ed-618d2877366e tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:24.863455 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2af48bcd-9433-40c9-aa24-23a0c0f68ada tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:24.912264 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2af48bcd-9433-40c9-aa24-23a0c0f68ada tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:24.912678 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2af48bcd-9433-40c9-aa24-23a0c0f68ada tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:24.913172 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e2f34d38-ad6a-469b-85ed-618d2877366e tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:24.913572 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e2f34d38-ad6a-469b-85ed-618d2877366e tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:24.914794 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2af48bcd-9433-40c9-aa24-23a0c0f68ada tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:24.915890 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2af48bcd-9433-40c9-aa24-23a0c0f68ada tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:24.916256 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e2f34d38-ad6a-469b-85ed-618d2877366e tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:24.918421 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e2f34d38-ad6a-469b-85ed-618d2877366e tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:25.205688 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2af48bcd-9433-40c9-aa24-23a0c0f68ada tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:25.264019 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e2f34d38-ad6a-469b-85ed-618d2877366e tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:25.279406 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2af48bcd-9433-40c9-aa24-23a0c0f68ada tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1502 microversion: 2.1 time: 0.429826 Nov 24 03:05:25.299592 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 125/219] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:24 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1502 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:25.308814 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e2f34d38-ad6a-469b-85ed-618d2877366e tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 200 len: 1313 microversion: 2.1 time: 0.473150 Nov 24 03:05:25.312093 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f1838886-df2f-4345-8c3d-6d038f2dd087 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:25.314699 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f1838886-df2f-4345-8c3d-6d038f2dd087 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:25.325332 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 95/220] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:24 2021] GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:25.339767 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f1838886-df2f-4345-8c3d-6d038f2dd087 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:25.340106 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-816d36e9-e901-45b5-a407-bd34797bc923 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1952673593", "imageRef": "04860a4a-47c3-4532-865d-be6c9c493af7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7a7cf95-a9a7-490c-b4d6-a3f8cc395176"}], "security_groups": [{"name": "tempest-securitygroup--382187708"}], "key_name": "tempest-keypair-526221247", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:25.341299 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f1838886-df2f-4345-8c3d-6d038f2dd087 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:25.343227 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f1838886-df2f-4345-8c3d-6d038f2dd087 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:25.345223 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f1838886-df2f-4345-8c3d-6d038f2dd087 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:25.455019 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f1838886-df2f-4345-8c3d-6d038f2dd087 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 28677 microversion: 2.20 time: 0.151009 Nov 24 03:05:25.455937 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 126/221] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:25 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 28677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:25.462935 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f3ad3dcd-5513-467f-a46c-ade0612399ba tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:25.464311 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f3ad3dcd-5513-467f-a46c-ade0612399ba tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:25.473511 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f3ad3dcd-5513-467f-a46c-ade0612399ba tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:25.474161 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f3ad3dcd-5513-467f-a46c-ade0612399ba tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:25.475130 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f3ad3dcd-5513-467f-a46c-ade0612399ba tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:25.475713 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f3ad3dcd-5513-467f-a46c-ade0612399ba tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:25.540447 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-816d36e9-e901-45b5-a407-bd34797bc923 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] validate_networks() for [('f7a7cf95-a9a7-490c-b4d6-a3f8cc395176', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:05:25.672230 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f3ad3dcd-5513-467f-a46c-ade0612399ba tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:25.686600 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f3ad3dcd-5513-467f-a46c-ade0612399ba tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 200 len: 1317 microversion: 2.1 time: 0.228501 Nov 24 03:05:25.688022 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 127/222] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:25 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:25.694704 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b1ce9692-8903-43a5-9fb5-e324a59d6570 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:25.695828 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b1ce9692-8903-43a5-9fb5-e324a59d6570 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:25.707258 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b1ce9692-8903-43a5-9fb5-e324a59d6570 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:25.708037 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b1ce9692-8903-43a5-9fb5-e324a59d6570 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:25.709664 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b1ce9692-8903-43a5-9fb5-e324a59d6570 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:25.710238 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b1ce9692-8903-43a5-9fb5-e324a59d6570 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:25.901212 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b1ce9692-8903-43a5-9fb5-e324a59d6570 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:25.911264 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b1ce9692-8903-43a5-9fb5-e324a59d6570 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1515 microversion: 2.1 time: 0.221546 Nov 24 03:05:25.912622 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 128/223] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:25 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1515 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:26.175909 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-816d36e9-e901-45b5-a407-bd34797bc923 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:05:26.176943 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-816d36e9-e901-45b5-a407-bd34797bc923 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:05:26.178317 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-816d36e9-e901-45b5-a407-bd34797bc923 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:05:26.178965 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-816d36e9-e901-45b5-a407-bd34797bc923 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:05:26.179776 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-816d36e9-e901-45b5-a407-bd34797bc923 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:05:26.198912 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-816d36e9-e901-45b5-a407-bd34797bc923 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:26.203581 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-816d36e9-e901-45b5-a407-bd34797bc923 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:26.205735 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-816d36e9-e901-45b5-a407-bd34797bc923 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:26.209800 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-816d36e9-e901-45b5-a407-bd34797bc923 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:26.277198 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-816d36e9-e901-45b5-a407-bd34797bc923 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Getting quotas for project 1368b90b7cae4e3d936fcd3a97893dc3. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:05:26.294421 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-816d36e9-e901-45b5-a407-bd34797bc923 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Getting quotas for user 22bd0f1d66884b66945eec4ede0aea0d and project 1368b90b7cae4e3d936fcd3a97893dc3. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:05:26.337514 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0f601e24-ae94-4c0e-ab0a-39835da8f399 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:26.338585 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0f601e24-ae94-4c0e-ab0a-39835da8f399 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:26.355148 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0f601e24-ae94-4c0e-ab0a-39835da8f399 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:26.355730 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-816d36e9-e901-45b5-a407-bd34797bc923 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:05:26.357632 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0f601e24-ae94-4c0e-ab0a-39835da8f399 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:26.359066 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0f601e24-ae94-4c0e-ab0a-39835da8f399 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:26.360555 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-816d36e9-e901-45b5-a407-bd34797bc923 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04860a4a-47c3-4532-865d-be6c9c493af7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:05:26.361091 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0f601e24-ae94-4c0e-ab0a-39835da8f399 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:26.490515 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-816d36e9-e901-45b5-a407-bd34797bc923 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.162194 Nov 24 03:05:26.491520 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 96/224] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Nov 24 03:05:25 2021] POST /compute/v2.1/servers => generated 401 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 03:05:26.522287 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0b67c4d3-d6fe-4fc0-8804-f6b55e35be70 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:26.533462 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0b67c4d3-d6fe-4fc0-8804-f6b55e35be70 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:26.549963 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b67c4d3-d6fe-4fc0-8804-f6b55e35be70 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:26.552055 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b67c4d3-d6fe-4fc0-8804-f6b55e35be70 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:26.553277 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b67c4d3-d6fe-4fc0-8804-f6b55e35be70 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:26.556101 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b67c4d3-d6fe-4fc0-8804-f6b55e35be70 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:26.659102 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0b67c4d3-d6fe-4fc0-8804-f6b55e35be70 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 28814 microversion: 2.20 time: 0.166001 Nov 24 03:05:26.664209 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 97/225] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:26 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 28814 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:26.670921 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8af63230-5db8-4a1b-9e69-1d85d9714a67 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:26.671984 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8af63230-5db8-4a1b-9e69-1d85d9714a67 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:26.782920 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8af63230-5db8-4a1b-9e69-1d85d9714a67 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:26.794149 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8af63230-5db8-4a1b-9e69-1d85d9714a67 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1237 microversion: 2.1 time: 0.127577 Nov 24 03:05:26.804939 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 98/226] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:26 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1237 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:26.809721 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ee670f9a-dcf4-4c31-a51a-452bb5816f2e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:26.811779 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ee670f9a-dcf4-4c31-a51a-452bb5816f2e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:26.826195 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ee670f9a-dcf4-4c31-a51a-452bb5816f2e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:26.826660 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ee670f9a-dcf4-4c31-a51a-452bb5816f2e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:26.827489 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ee670f9a-dcf4-4c31-a51a-452bb5816f2e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:26.827923 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ee670f9a-dcf4-4c31-a51a-452bb5816f2e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:26.908563 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0f601e24-ae94-4c0e-ab0a-39835da8f399 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:26.928698 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0f601e24-ae94-4c0e-ab0a-39835da8f399 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 200 len: 1313 microversion: 2.1 time: 0.594916 Nov 24 03:05:26.931524 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 129/227] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:26 2021] GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:05:27.206308 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ee670f9a-dcf4-4c31-a51a-452bb5816f2e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:27.233432 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-cc0dcac4-c930-458c-95f8-57e09172abd4 req-1b096f32-81d3-4e9e-87fd-7de5235e3229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41", "name": "network-vif-plugged", "status": "completed", "tag": "b33d4a02-2fae-4346-aa95-aaabcd7a9bb4"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:27.234190 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ee670f9a-dcf4-4c31-a51a-452bb5816f2e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 200 len: 1317 microversion: 2.1 time: 0.434418 Nov 24 03:05:27.236160 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:05:27.236160 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:05:27.240610 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 99/228] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:26 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:27.257768 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-cc0dcac4-c930-458c-95f8-57e09172abd4 req-1b096f32-81d3-4e9e-87fd-7de5235e3229 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:27.258398 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-cc0dcac4-c930-458c-95f8-57e09172abd4 req-1b096f32-81d3-4e9e-87fd-7de5235e3229 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:27.275842 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-cc0dcac4-c930-458c-95f8-57e09172abd4 req-1b096f32-81d3-4e9e-87fd-7de5235e3229 service nova] Creating event network-vif-plugged:b33d4a02-2fae-4346-aa95-aaabcd7a9bb4 for instance 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 on hv-cinder-81803 Nov 24 03:05:27.284049 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-cc0dcac4-c930-458c-95f8-57e09172abd4 req-1b096f32-81d3-4e9e-87fd-7de5235e3229 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055603 Nov 24 03:05:27.285068 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 130/229] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:05:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:05:27.675850 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-62aa4d87-2bc2-4ee3-8418-43c349a7c8ef tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:27.677385 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-62aa4d87-2bc2-4ee3-8418-43c349a7c8ef tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:27.696587 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-62aa4d87-2bc2-4ee3-8418-43c349a7c8ef tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:27.697365 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-62aa4d87-2bc2-4ee3-8418-43c349a7c8ef tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:27.698842 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-62aa4d87-2bc2-4ee3-8418-43c349a7c8ef tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:27.699998 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-62aa4d87-2bc2-4ee3-8418-43c349a7c8ef tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:27.814629 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f5079cb7-c113-485a-84f8-2fe7c0ed5fec tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:27.816335 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f5079cb7-c113-485a-84f8-2fe7c0ed5fec tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:27.826585 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f5079cb7-c113-485a-84f8-2fe7c0ed5fec tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:27.828871 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f5079cb7-c113-485a-84f8-2fe7c0ed5fec tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:27.829869 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f5079cb7-c113-485a-84f8-2fe7c0ed5fec tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:27.833766 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f5079cb7-c113-485a-84f8-2fe7c0ed5fec tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:28.047356 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f5079cb7-c113-485a-84f8-2fe7c0ed5fec tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:28.050151 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-62aa4d87-2bc2-4ee3-8418-43c349a7c8ef tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 30762 microversion: 2.20 time: 0.380628 Nov 24 03:05:28.058611 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 100/230] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:27 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 30762 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:28.070326 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6a0a8b3e-7459-44a3-90ae-64c6ef842061 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:28.071885 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6a0a8b3e-7459-44a3-90ae-64c6ef842061 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:28.086168 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6a0a8b3e-7459-44a3-90ae-64c6ef842061 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:28.087207 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6a0a8b3e-7459-44a3-90ae-64c6ef842061 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:28.088939 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6a0a8b3e-7459-44a3-90ae-64c6ef842061 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:28.090638 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6a0a8b3e-7459-44a3-90ae-64c6ef842061 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:28.111453 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f5079cb7-c113-485a-84f8-2fe7c0ed5fec tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1289 microversion: 2.1 time: 0.300745 Nov 24 03:05:28.113181 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 131/231] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:27 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1289 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:28.157091 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b05769b1-7296-4eb6-b25c-09adc6303eb4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:28.162781 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b05769b1-7296-4eb6-b25c-09adc6303eb4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:28.195890 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b05769b1-7296-4eb6-b25c-09adc6303eb4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:28.196693 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b05769b1-7296-4eb6-b25c-09adc6303eb4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:28.198289 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b05769b1-7296-4eb6-b25c-09adc6303eb4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:28.199105 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b05769b1-7296-4eb6-b25c-09adc6303eb4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:28.274568 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.objects.instance [None req-b05769b1-7296-4eb6-b25c-09adc6303eb4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lazy-loading 'flavor' on Instance uuid 6bd67a95-85a5-4669-bc7b-2d50f1716c54 {{(pid=116331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:05:28.381060 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6a0a8b3e-7459-44a3-90ae-64c6ef842061 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:28.391861 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6a0a8b3e-7459-44a3-90ae-64c6ef842061 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 200 len: 1313 microversion: 2.1 time: 0.330220 Nov 24 03:05:28.392729 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 101/232] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:28 2021] GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:28.407662 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-26bf40c4-c87a-4bef-b6cf-7ae352304269 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:28.408277 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-26bf40c4-c87a-4bef-b6cf-7ae352304269 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:28.419325 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-26bf40c4-c87a-4bef-b6cf-7ae352304269 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:28.419976 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-26bf40c4-c87a-4bef-b6cf-7ae352304269 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:28.420796 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-26bf40c4-c87a-4bef-b6cf-7ae352304269 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:28.421350 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-26bf40c4-c87a-4bef-b6cf-7ae352304269 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:28.451787 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b05769b1-7296-4eb6-b25c-09adc6303eb4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "POST /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/action" status: 200 len: 32 microversion: 2.1 time: 0.305717 Nov 24 03:05:28.458642 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 132/233] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:05:28 2021] POST /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/action => generated 32 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:05:28.470420 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-595a5e30-1c97-4f3a-9446-f01ea9938b07 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:28.472331 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-595a5e30-1c97-4f3a-9446-f01ea9938b07 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:28.485819 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-595a5e30-1c97-4f3a-9446-f01ea9938b07 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:28.486927 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-595a5e30-1c97-4f3a-9446-f01ea9938b07 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:28.487930 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-595a5e30-1c97-4f3a-9446-f01ea9938b07 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:28.488521 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-595a5e30-1c97-4f3a-9446-f01ea9938b07 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:28.858678 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-26bf40c4-c87a-4bef-b6cf-7ae352304269 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:28.869197 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-26bf40c4-c87a-4bef-b6cf-7ae352304269 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 200 len: 1317 microversion: 2.1 time: 0.473837 Nov 24 03:05:28.876351 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 102/234] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:28 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 1317 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:28.935196 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-595a5e30-1c97-4f3a-9446-f01ea9938b07 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:28.946238 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-595a5e30-1c97-4f3a-9446-f01ea9938b07 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.484023 Nov 24 03:05:28.958797 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 133/235] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:28 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:29.066548 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d2640bc7-bd42-43c1-a2c5-ff546508dc8f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:29.067825 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d2640bc7-bd42-43c1-a2c5-ff546508dc8f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:29.075885 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2640bc7-bd42-43c1-a2c5-ff546508dc8f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:29.076481 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2640bc7-bd42-43c1-a2c5-ff546508dc8f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:29.077448 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2640bc7-bd42-43c1-a2c5-ff546508dc8f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:29.078206 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2640bc7-bd42-43c1-a2c5-ff546508dc8f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:29.161548 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-159d1381-a1fa-4d48-8cbd-c487ac6786dd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:29.162950 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-159d1381-a1fa-4d48-8cbd-c487ac6786dd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:29.174534 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-159d1381-a1fa-4d48-8cbd-c487ac6786dd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:29.175641 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-159d1381-a1fa-4d48-8cbd-c487ac6786dd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:29.177893 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-159d1381-a1fa-4d48-8cbd-c487ac6786dd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:29.179120 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-159d1381-a1fa-4d48-8cbd-c487ac6786dd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:29.198311 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d2640bc7-bd42-43c1-a2c5-ff546508dc8f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 32325 microversion: 2.20 time: 0.135714 Nov 24 03:05:29.199742 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 103/236] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:29 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 32325 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:29.359387 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-159d1381-a1fa-4d48-8cbd-c487ac6786dd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:29.373248 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-159d1381-a1fa-4d48-8cbd-c487ac6786dd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1295 microversion: 2.1 time: 0.220531 Nov 24 03:05:29.374507 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 134/237] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:29 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1295 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:29.420981 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7d4964ce-13b7-46ae-9ea0-9fdda1d0d0cf tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:29.421659 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7d4964ce-13b7-46ae-9ea0-9fdda1d0d0cf tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:29.431245 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d4964ce-13b7-46ae-9ea0-9fdda1d0d0cf tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:29.432454 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d4964ce-13b7-46ae-9ea0-9fdda1d0d0cf tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:29.434001 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d4964ce-13b7-46ae-9ea0-9fdda1d0d0cf tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:29.434729 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d4964ce-13b7-46ae-9ea0-9fdda1d0d0cf tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:29.652258 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7d4964ce-13b7-46ae-9ea0-9fdda1d0d0cf tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:29.662499 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7d4964ce-13b7-46ae-9ea0-9fdda1d0d0cf tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 200 len: 1497 microversion: 2.1 time: 0.246393 Nov 24 03:05:29.663872 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 104/238] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:29 2021] GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 1497 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:29.908781 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-79611144-18f9-4b44-8446-a826ec2c8fde tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:29.909379 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-79611144-18f9-4b44-8446-a826ec2c8fde tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:29.922704 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-79611144-18f9-4b44-8446-a826ec2c8fde tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:29.924239 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-79611144-18f9-4b44-8446-a826ec2c8fde tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:29.926462 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-79611144-18f9-4b44-8446-a826ec2c8fde tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:29.927551 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-79611144-18f9-4b44-8446-a826ec2c8fde tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:29.967125 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-cbc147c4-5d19-4767-8ea5-3b98d64b1c55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:29.970719 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-cbc147c4-5d19-4767-8ea5-3b98d64b1c55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:29.997473 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cbc147c4-5d19-4767-8ea5-3b98d64b1c55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:29.998497 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cbc147c4-5d19-4767-8ea5-3b98d64b1c55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:30.005474 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cbc147c4-5d19-4767-8ea5-3b98d64b1c55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:30.008899 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cbc147c4-5d19-4767-8ea5-3b98d64b1c55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:30.508514 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-cbc147c4-5d19-4767-8ea5-3b98d64b1c55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:30.524939 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-cbc147c4-5d19-4767-8ea5-3b98d64b1c55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.562735 Nov 24 03:05:30.527137 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 105/239] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:29 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:30.536826 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f89fae02-977e-4559-a694-bbf0769b612a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:30.539020 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f89fae02-977e-4559-a694-bbf0769b612a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:30.577242 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f89fae02-977e-4559-a694-bbf0769b612a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:30.578570 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f89fae02-977e-4559-a694-bbf0769b612a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:30.580706 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f89fae02-977e-4559-a694-bbf0769b612a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:30.581956 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f89fae02-977e-4559-a694-bbf0769b612a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:30.622020 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-79611144-18f9-4b44-8446-a826ec2c8fde tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:30.633985 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-79611144-18f9-4b44-8446-a826ec2c8fde tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 200 len: 1317 microversion: 2.1 time: 0.730477 Nov 24 03:05:30.635338 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 135/240] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:29 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 1317 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:30.650924 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-938b715d-ffb7-4d05-85dd-3f766f7e9633 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:30.655728 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-938b715d-ffb7-4d05-85dd-3f766f7e9633 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:30.670992 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-938b715d-ffb7-4d05-85dd-3f766f7e9633 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:30.672208 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-938b715d-ffb7-4d05-85dd-3f766f7e9633 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:30.673691 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-938b715d-ffb7-4d05-85dd-3f766f7e9633 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:30.674517 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-938b715d-ffb7-4d05-85dd-3f766f7e9633 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:30.765684 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f89fae02-977e-4559-a694-bbf0769b612a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 33353 microversion: 2.20 time: 0.235792 Nov 24 03:05:30.779883 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 106/241] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:30 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 33353 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:30.791893 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-550c75e0-19b8-48f1-920b-1bb94978c60d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:30.792483 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-550c75e0-19b8-48f1-920b-1bb94978c60d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:30.838509 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-550c75e0-19b8-48f1-920b-1bb94978c60d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:30.841053 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-550c75e0-19b8-48f1-920b-1bb94978c60d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:30.842057 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-550c75e0-19b8-48f1-920b-1bb94978c60d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:30.842528 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-550c75e0-19b8-48f1-920b-1bb94978c60d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:30.909733 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-550c75e0-19b8-48f1-920b-1bb94978c60d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:05:31.073318 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-550c75e0-19b8-48f1-920b-1bb94978c60d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 204 len: 0 microversion: 2.1 time: 0.289334 Nov 24 03:05:31.076339 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 107/242] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:05:30 2021] DELETE /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:05:31.105807 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7a581480-cf95-4f55-a3a7-ca5900ddc5b1 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:31.106862 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7a581480-cf95-4f55-a3a7-ca5900ddc5b1 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:31.118527 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7a581480-cf95-4f55-a3a7-ca5900ddc5b1 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:31.121391 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7a581480-cf95-4f55-a3a7-ca5900ddc5b1 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:31.122446 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7a581480-cf95-4f55-a3a7-ca5900ddc5b1 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:31.123917 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7a581480-cf95-4f55-a3a7-ca5900ddc5b1 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:31.325541 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-938b715d-ffb7-4d05-85dd-3f766f7e9633 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:31.338749 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-938b715d-ffb7-4d05-85dd-3f766f7e9633 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1362 microversion: 2.1 time: 0.700457 Nov 24 03:05:31.352553 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 136/243] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:30 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1362 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:31.376851 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-820ee9ba-453a-462c-8e4e-c036ea0a99b5 req-b899a394-713a-414e-8600-317f1c1ff218 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9b822e-b442-450a-acaa-df8261422f50", "tag": "c3568a99-3dfd-41f8-9643-ad9aa328f79e"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:31.391492 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:05:31.391492 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:05:31.401704 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-820ee9ba-453a-462c-8e4e-c036ea0a99b5 req-b899a394-713a-414e-8600-317f1c1ff218 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:31.402709 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-820ee9ba-453a-462c-8e4e-c036ea0a99b5 req-b899a394-713a-414e-8600-317f1c1ff218 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:31.417091 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-820ee9ba-453a-462c-8e4e-c036ea0a99b5 req-b899a394-713a-414e-8600-317f1c1ff218 service nova] Creating event network-changed:c3568a99-3dfd-41f8-9643-ad9aa328f79e for instance dd9b822e-b442-450a-acaa-df8261422f50 on hv-cinder-81803 Nov 24 03:05:31.424759 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-820ee9ba-453a-462c-8e4e-c036ea0a99b5 req-b899a394-713a-414e-8600-317f1c1ff218 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070587 Nov 24 03:05:31.425674 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 137/244] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:05:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:05:31.431614 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-911095c1-9c1a-47be-b41c-9042165a570e req-7021eb9e-49bf-4546-9db4-1d699e05dec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d57fe44d-e7d6-4188-b8aa-343ca2963f68", "name": "network-vif-plugged", "status": "completed", "tag": "0369e643-d459-41b8-9f2d-380b361c90bf"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:31.434408 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:05:31.434408 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:05:31.463761 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-911095c1-9c1a-47be-b41c-9042165a570e req-7021eb9e-49bf-4546-9db4-1d699e05dec1 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:31.465064 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-911095c1-9c1a-47be-b41c-9042165a570e req-7021eb9e-49bf-4546-9db4-1d699e05dec1 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:31.493232 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-911095c1-9c1a-47be-b41c-9042165a570e req-7021eb9e-49bf-4546-9db4-1d699e05dec1 service nova] Creating event network-vif-plugged:0369e643-d459-41b8-9f2d-380b361c90bf for instance d57fe44d-e7d6-4188-b8aa-343ca2963f68 on hv-cinder-81803 Nov 24 03:05:31.520333 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-911095c1-9c1a-47be-b41c-9042165a570e req-7021eb9e-49bf-4546-9db4-1d699e05dec1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093036 Nov 24 03:05:31.520950 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 138/245] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:05:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:05:31.571015 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e05edc09-b8a5-4ab2-9ee2-ed1497ba9dc7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:31.572128 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e05edc09-b8a5-4ab2-9ee2-ed1497ba9dc7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:31.595517 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e05edc09-b8a5-4ab2-9ee2-ed1497ba9dc7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:31.600678 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e05edc09-b8a5-4ab2-9ee2-ed1497ba9dc7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:31.602349 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e05edc09-b8a5-4ab2-9ee2-ed1497ba9dc7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:31.603141 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e05edc09-b8a5-4ab2-9ee2-ed1497ba9dc7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:31.606963 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7a581480-cf95-4f55-a3a7-ca5900ddc5b1 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:31.615011 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7a581480-cf95-4f55-a3a7-ca5900ddc5b1 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 200 len: 1503 microversion: 2.1 time: 0.526529 Nov 24 03:05:31.615614 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 108/246] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:31 2021] GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 1503 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:31.667655 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6837e584-d2d8-4d9d-9706-aaf39be7a534 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:31.668540 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6837e584-d2d8-4d9d-9706-aaf39be7a534 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:31.689226 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6837e584-d2d8-4d9d-9706-aaf39be7a534 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:31.689731 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6837e584-d2d8-4d9d-9706-aaf39be7a534 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:31.690623 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6837e584-d2d8-4d9d-9706-aaf39be7a534 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:31.691070 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6837e584-d2d8-4d9d-9706-aaf39be7a534 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:32.035027 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6837e584-d2d8-4d9d-9706-aaf39be7a534 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:32.040743 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e05edc09-b8a5-4ab2-9ee2-ed1497ba9dc7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:32.048225 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6837e584-d2d8-4d9d-9706-aaf39be7a534 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 200 len: 1317 microversion: 2.1 time: 0.387630 Nov 24 03:05:32.050971 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 109/247] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:31 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:05:32.065476 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a9b1481c-6944-4f09-a522-770f108b5f67 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:32.067213 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a9b1481c-6944-4f09-a522-770f108b5f67 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:32.074573 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a9b1481c-6944-4f09-a522-770f108b5f67 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:32.075166 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a9b1481c-6944-4f09-a522-770f108b5f67 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:32.076115 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a9b1481c-6944-4f09-a522-770f108b5f67 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:32.076680 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a9b1481c-6944-4f09-a522-770f108b5f67 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:32.081657 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e05edc09-b8a5-4ab2-9ee2-ed1497ba9dc7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.527864 Nov 24 03:05:32.082609 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 139/248] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:31 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:32.372348 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-958ab18e-c589-4926-b2bb-8525a731d386 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:32.373569 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-958ab18e-c589-4926-b2bb-8525a731d386 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:32.384213 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a9b1481c-6944-4f09-a522-770f108b5f67 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 34161 microversion: 2.20 time: 0.331456 Nov 24 03:05:32.385425 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-958ab18e-c589-4926-b2bb-8525a731d386 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:32.386530 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-958ab18e-c589-4926-b2bb-8525a731d386 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:32.388027 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-958ab18e-c589-4926-b2bb-8525a731d386 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:32.388892 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-958ab18e-c589-4926-b2bb-8525a731d386 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:32.389289 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 110/249] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:32 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 34161 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:32.646439 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7d2c1034-d95a-4eec-a398-d06737e8f323 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:32.646439 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7d2c1034-d95a-4eec-a398-d06737e8f323 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:32.646439 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d2c1034-d95a-4eec-a398-d06737e8f323 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:32.646439 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d2c1034-d95a-4eec-a398-d06737e8f323 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:32.647651 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d2c1034-d95a-4eec-a398-d06737e8f323 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:32.647651 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d2c1034-d95a-4eec-a398-d06737e8f323 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:32.793052 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-958ab18e-c589-4926-b2bb-8525a731d386 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:32.812967 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-958ab18e-c589-4926-b2bb-8525a731d386 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1362 microversion: 2.1 time: 0.459151 Nov 24 03:05:32.813816 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 140/250] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:32 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1362 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:33.029431 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7d2c1034-d95a-4eec-a398-d06737e8f323 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:33.039599 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7d2c1034-d95a-4eec-a398-d06737e8f323 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 200 len: 1503 microversion: 2.1 time: 0.405681 Nov 24 03:05:33.040281 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 111/251] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:32 2021] GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 1503 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:05:33.084235 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c02569ec-2e43-4501-9254-56ae56db4046 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:33.086098 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c02569ec-2e43-4501-9254-56ae56db4046 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:33.100953 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-79f8b655-50c6-488f-a42c-fe4e8e01f9be tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:33.101563 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-79f8b655-50c6-488f-a42c-fe4e8e01f9be tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:33.103725 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c02569ec-2e43-4501-9254-56ae56db4046 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:33.111009 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c02569ec-2e43-4501-9254-56ae56db4046 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:33.115295 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79f8b655-50c6-488f-a42c-fe4e8e01f9be tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:33.115892 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79f8b655-50c6-488f-a42c-fe4e8e01f9be tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:33.116728 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79f8b655-50c6-488f-a42c-fe4e8e01f9be tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:33.118088 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c02569ec-2e43-4501-9254-56ae56db4046 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:33.118779 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c02569ec-2e43-4501-9254-56ae56db4046 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:33.124098 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79f8b655-50c6-488f-a42c-fe4e8e01f9be tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:33.410744 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-79f8b655-50c6-488f-a42c-fe4e8e01f9be tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:33.422694 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-79f8b655-50c6-488f-a42c-fe4e8e01f9be tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.325535 Nov 24 03:05:33.423823 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 112/252] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:33 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:33.434814 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5c5f4f2d-4227-487b-9dea-4059e633d551 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:33.436171 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5c5f4f2d-4227-487b-9dea-4059e633d551 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:33.451545 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5c5f4f2d-4227-487b-9dea-4059e633d551 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:33.452371 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5c5f4f2d-4227-487b-9dea-4059e633d551 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:33.453460 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5c5f4f2d-4227-487b-9dea-4059e633d551 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:33.455472 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5c5f4f2d-4227-487b-9dea-4059e633d551 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:33.474816 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c02569ec-2e43-4501-9254-56ae56db4046 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:33.490557 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c02569ec-2e43-4501-9254-56ae56db4046 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 200 len: 1317 microversion: 2.1 time: 0.416535 Nov 24 03:05:33.506465 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 141/253] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:33 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:33.627673 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5c5f4f2d-4227-487b-9dea-4059e633d551 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 34352 microversion: 2.20 time: 0.201730 Nov 24 03:05:33.628972 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 113/254] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:33 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 34352 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:33.835264 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ac69950a-f657-4261-a2a0-cc53ffef9528 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:33.836386 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ac69950a-f657-4261-a2a0-cc53ffef9528 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:33.853280 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ac69950a-f657-4261-a2a0-cc53ffef9528 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:33.854135 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ac69950a-f657-4261-a2a0-cc53ffef9528 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:33.855751 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ac69950a-f657-4261-a2a0-cc53ffef9528 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:33.856504 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ac69950a-f657-4261-a2a0-cc53ffef9528 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:34.061026 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b0444a8d-4857-41dd-891f-9af992610dd7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:34.063109 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b0444a8d-4857-41dd-891f-9af992610dd7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:34.075362 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b0444a8d-4857-41dd-891f-9af992610dd7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:34.076204 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b0444a8d-4857-41dd-891f-9af992610dd7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:34.077584 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b0444a8d-4857-41dd-891f-9af992610dd7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:34.078341 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b0444a8d-4857-41dd-891f-9af992610dd7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:34.253321 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ac69950a-f657-4261-a2a0-cc53ffef9528 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:34.262445 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ac69950a-f657-4261-a2a0-cc53ffef9528 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1362 microversion: 2.1 time: 0.435640 Nov 24 03:05:34.263355 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 142/255] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:33 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1362 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:34.441483 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-88d8e547-77fe-46db-841d-72ad50e741a7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:34.442424 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-88d8e547-77fe-46db-841d-72ad50e741a7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:34.453072 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-88d8e547-77fe-46db-841d-72ad50e741a7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:34.453575 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-88d8e547-77fe-46db-841d-72ad50e741a7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:34.454936 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-88d8e547-77fe-46db-841d-72ad50e741a7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:34.455408 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-88d8e547-77fe-46db-841d-72ad50e741a7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:34.640387 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-88d8e547-77fe-46db-841d-72ad50e741a7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:34.652511 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-88d8e547-77fe-46db-841d-72ad50e741a7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.215201 Nov 24 03:05:34.663830 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 143/256] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:34 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:34.676630 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-58156361-f359-47b7-bf91-da9dd51fdcb0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:34.679651 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-58156361-f359-47b7-bf91-da9dd51fdcb0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:34.695689 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-58156361-f359-47b7-bf91-da9dd51fdcb0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:34.698740 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-58156361-f359-47b7-bf91-da9dd51fdcb0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:34.700616 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-58156361-f359-47b7-bf91-da9dd51fdcb0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:34.701294 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-58156361-f359-47b7-bf91-da9dd51fdcb0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:34.823876 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b0444a8d-4857-41dd-891f-9af992610dd7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:34.841162 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b0444a8d-4857-41dd-891f-9af992610dd7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 200 len: 1503 microversion: 2.1 time: 0.787702 Nov 24 03:05:34.841768 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 114/257] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:34 2021] GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 1503 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:34.849312 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d2fc500d-3ee8-453a-bd14-1aad462d1774 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:34.850624 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d2fc500d-3ee8-453a-bd14-1aad462d1774 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:34.866240 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2fc500d-3ee8-453a-bd14-1aad462d1774 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:34.869071 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2fc500d-3ee8-453a-bd14-1aad462d1774 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:34.870200 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2fc500d-3ee8-453a-bd14-1aad462d1774 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:34.870943 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2fc500d-3ee8-453a-bd14-1aad462d1774 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:34.903229 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-58156361-f359-47b7-bf91-da9dd51fdcb0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:34.911645 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-58156361-f359-47b7-bf91-da9dd51fdcb0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 200 len: 1507 microversion: 2.1 time: 0.246397 Nov 24 03:05:34.912811 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 144/258] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:34 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 1507 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:34.983315 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d2fc500d-3ee8-453a-bd14-1aad462d1774 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 35084 microversion: 2.20 time: 0.140121 Nov 24 03:05:34.984088 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 115/259] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:34 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 35084 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:35.283428 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-a617b153-b7f8-465c-b354-699f60a49372 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:35.292441 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-a617b153-b7f8-465c-b354-699f60a49372 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:35.325419 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a617b153-b7f8-465c-b354-699f60a49372 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:35.328508 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a617b153-b7f8-465c-b354-699f60a49372 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:35.335872 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a617b153-b7f8-465c-b354-699f60a49372 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:35.338445 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a617b153-b7f8-465c-b354-699f60a49372 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:35.397189 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-3ac9c3c8-1cee-4024-b9ed-e69967e3d7ea req-1c6eca17-aeec-4e0f-800d-9f44829bac66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41", "name": "network-vif-deleted", "tag": "b33d4a02-2fae-4346-aa95-aaabcd7a9bb4"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:35.399642 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:05:35.399642 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:05:35.420193 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-3ac9c3c8-1cee-4024-b9ed-e69967e3d7ea req-1c6eca17-aeec-4e0f-800d-9f44829bac66 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:35.422102 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-3ac9c3c8-1cee-4024-b9ed-e69967e3d7ea req-1c6eca17-aeec-4e0f-800d-9f44829bac66 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:35.457896 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-3ac9c3c8-1cee-4024-b9ed-e69967e3d7ea req-1c6eca17-aeec-4e0f-800d-9f44829bac66 service nova] Creating event network-vif-deleted:b33d4a02-2fae-4346-aa95-aaabcd7a9bb4 for instance 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 on hv-cinder-81803 Nov 24 03:05:35.479015 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-3ac9c3c8-1cee-4024-b9ed-e69967e3d7ea req-1c6eca17-aeec-4e0f-800d-9f44829bac66 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085948 Nov 24 03:05:35.480062 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 116/260] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:05:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:05:35.678839 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2db7e381-a147-4d4f-93f9-0949d79f9575 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:35.680125 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2db7e381-a147-4d4f-93f9-0949d79f9575 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:35.688973 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-a617b153-b7f8-465c-b354-699f60a49372 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:35.699760 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-a617b153-b7f8-465c-b354-699f60a49372 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1362 microversion: 2.1 time: 0.422336 Nov 24 03:05:35.702722 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 145/261] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:35 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1362 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:35.707739 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2db7e381-a147-4d4f-93f9-0949d79f9575 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:35.712572 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2db7e381-a147-4d4f-93f9-0949d79f9575 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:35.718142 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2db7e381-a147-4d4f-93f9-0949d79f9575 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:35.718926 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2db7e381-a147-4d4f-93f9-0949d79f9575 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:35.859554 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7cad0aeb-ad60-41a2-915f-869440bd9002 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:35.860134 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-7cad0aeb-ad60-41a2-915f-869440bd9002 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:35.866455 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7cad0aeb-ad60-41a2-915f-869440bd9002 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:35.867254 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7cad0aeb-ad60-41a2-915f-869440bd9002 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:35.868268 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7cad0aeb-ad60-41a2-915f-869440bd9002 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:35.868907 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7cad0aeb-ad60-41a2-915f-869440bd9002 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:35.919389 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7cad0aeb-ad60-41a2-915f-869440bd9002 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:35.920246 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7cad0aeb-ad60-41a2-915f-869440bd9002 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:35.921106 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.objects.instance [None req-7cad0aeb-ad60-41a2-915f-869440bd9002 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lazy-loading 'fault' on Instance uuid 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 {{(pid=116331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:05:35.996667 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7cad0aeb-ad60-41a2-915f-869440bd9002 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:36.005644 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7cad0aeb-ad60-41a2-915f-869440bd9002 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 200 len: 1303 microversion: 2.1 time: 0.149906 Nov 24 03:05:36.017561 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 146/262] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:35 2021] GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 1303 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:36.027884 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-fca6997b-c2ca-4ab4-b25c-bff02d098ce7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:36.029451 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-fca6997b-c2ca-4ab4-b25c-bff02d098ce7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:36.035474 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2db7e381-a147-4d4f-93f9-0949d79f9575 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:36.039290 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fca6997b-c2ca-4ab4-b25c-bff02d098ce7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:36.040026 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fca6997b-c2ca-4ab4-b25c-bff02d098ce7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:36.043465 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fca6997b-c2ca-4ab4-b25c-bff02d098ce7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:36.044000 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fca6997b-c2ca-4ab4-b25c-bff02d098ce7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:36.061670 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2db7e381-a147-4d4f-93f9-0949d79f9575 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.394195 Nov 24 03:05:36.062441 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 117/263] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:35 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:05:36.183796 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-fca6997b-c2ca-4ab4-b25c-bff02d098ce7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 35879 microversion: 2.20 time: 0.163538 Nov 24 03:05:36.184268 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 147/264] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:36 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 35879 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:36.450608 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3f1d178d-83e0-47cc-9875-d4a9442a6845 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ceaa78e8-bb98-424a-8f8d-29c08415bd46"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:36.451689 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3f1d178d-83e0-47cc-9875-d4a9442a6845 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:36.462380 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f1d178d-83e0-47cc-9875-d4a9442a6845 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:36.464134 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f1d178d-83e0-47cc-9875-d4a9442a6845 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:36.469111 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f1d178d-83e0-47cc-9875-d4a9442a6845 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:36.469986 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f1d178d-83e0-47cc-9875-d4a9442a6845 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:36.725422 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f14001b8-1302-4da5-b5a7-9cfde48ffde4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:36.726288 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f14001b8-1302-4da5-b5a7-9cfde48ffde4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:36.756561 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f14001b8-1302-4da5-b5a7-9cfde48ffde4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:36.757016 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f14001b8-1302-4da5-b5a7-9cfde48ffde4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:36.757964 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f14001b8-1302-4da5-b5a7-9cfde48ffde4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:36.762468 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f14001b8-1302-4da5-b5a7-9cfde48ffde4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:37.024490 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3f1d178d-83e0-47cc-9875-d4a9442a6845 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "POST /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.578666 Nov 24 03:05:37.025135 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 118/265] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Nov 24 03:05:36 2021] POST /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68/os-volume_attachments => generated 194 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:05:37.030327 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ac95995c-c747-43b7-a7e7-fc7fdbbbb518 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:37.031030 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ac95995c-c747-43b7-a7e7-fc7fdbbbb518 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:37.056988 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac95995c-c747-43b7-a7e7-fc7fdbbbb518 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:37.057544 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac95995c-c747-43b7-a7e7-fc7fdbbbb518 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:37.058477 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac95995c-c747-43b7-a7e7-fc7fdbbbb518 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:37.058937 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac95995c-c747-43b7-a7e7-fc7fdbbbb518 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:37.083109 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-ac95995c-c747-43b7-a7e7-fc7fdbbbb518 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] HTTP exception thrown: Instance 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 could not be found. Nov 24 03:05:37.084236 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ac95995c-c747-43b7-a7e7-fc7fdbbbb518 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Returning 404 to user: Instance 1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:05:37.085397 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ac95995c-c747-43b7-a7e7-fc7fdbbbb518 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41" status: 404 len: 111 microversion: 2.1 time: 0.059180 Nov 24 03:05:37.100676 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 119/266] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:37 2021] GET /compute/v2.1/servers/1e53e7a0-7d51-45dd-b6d6-85a8f9ab0e41 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:05:37.111693 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c7beb2b1-db96-4467-aa3e-1a9388b8a90a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:37.115363 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c7beb2b1-db96-4467-aa3e-1a9388b8a90a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:37.138523 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c7beb2b1-db96-4467-aa3e-1a9388b8a90a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:37.139623 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c7beb2b1-db96-4467-aa3e-1a9388b8a90a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:37.139897 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c7beb2b1-db96-4467-aa3e-1a9388b8a90a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:37.140561 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c7beb2b1-db96-4467-aa3e-1a9388b8a90a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:37.240591 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f14001b8-1302-4da5-b5a7-9cfde48ffde4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:37.250985 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f14001b8-1302-4da5-b5a7-9cfde48ffde4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1362 microversion: 2.1 time: 0.535178 Nov 24 03:05:37.251971 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 148/267] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:36 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1362 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:37.267955 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-54e2f014-7fbb-435d-b752-1321317ff6d5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:37.270082 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-54e2f014-7fbb-435d-b752-1321317ff6d5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:37.280558 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-54e2f014-7fbb-435d-b752-1321317ff6d5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:37.285823 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-54e2f014-7fbb-435d-b752-1321317ff6d5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:37.287057 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-54e2f014-7fbb-435d-b752-1321317ff6d5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:37.287735 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-54e2f014-7fbb-435d-b752-1321317ff6d5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:37.392676 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-54e2f014-7fbb-435d-b752-1321317ff6d5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 37029 microversion: 2.20 time: 0.129144 Nov 24 03:05:37.394026 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 149/268] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:37 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 37029 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:37.400029 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e397fb24-8fe2-4cd0-847d-8e71737bd23a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1384987209", "imageRef": "04860a4a-47c3-4532-865d-be6c9c493af7", "flavorRef": "452", "networks": [{"uuid": "922d2004-5882-4bf8-8fc8-00da4513861f"}]}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:37.475932 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c7beb2b1-db96-4467-aa3e-1a9388b8a90a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:37.494891 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c7beb2b1-db96-4467-aa3e-1a9388b8a90a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.392169 Nov 24 03:05:37.496073 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 120/269] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:37 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:38.270699 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3dc526f4-3421-4703-b9e1-5331bc7d4dfb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:38.271387 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3dc526f4-3421-4703-b9e1-5331bc7d4dfb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:38.297762 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3dc526f4-3421-4703-b9e1-5331bc7d4dfb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:38.298684 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3dc526f4-3421-4703-b9e1-5331bc7d4dfb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:38.301485 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3dc526f4-3421-4703-b9e1-5331bc7d4dfb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:38.302278 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3dc526f4-3421-4703-b9e1-5331bc7d4dfb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:38.651304 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3dc526f4-3421-4703-b9e1-5331bc7d4dfb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:38.662040 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3dc526f4-3421-4703-b9e1-5331bc7d4dfb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1362 microversion: 2.1 time: 0.395766 Nov 24 03:05:38.671097 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 121/270] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:38 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1362 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:38.676617 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-636576d5-ba43-4874-8c78-186148ba6ae0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:38.678180 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-636576d5-ba43-4874-8c78-186148ba6ae0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:38.686085 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-636576d5-ba43-4874-8c78-186148ba6ae0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:38.686647 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-636576d5-ba43-4874-8c78-186148ba6ae0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:38.687924 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-636576d5-ba43-4874-8c78-186148ba6ae0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:38.688651 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-636576d5-ba43-4874-8c78-186148ba6ae0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:38.788245 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-636576d5-ba43-4874-8c78-186148ba6ae0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 38116 microversion: 2.20 time: 0.115261 Nov 24 03:05:38.790461 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 122/271] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:38 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 38116 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:38.795063 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e8b65889-fa7b-487c-96cf-a6ff942a4cf2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:38.796004 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e8b65889-fa7b-487c-96cf-a6ff942a4cf2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:38.807334 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8b65889-fa7b-487c-96cf-a6ff942a4cf2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:38.807824 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8b65889-fa7b-487c-96cf-a6ff942a4cf2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:38.809311 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8b65889-fa7b-487c-96cf-a6ff942a4cf2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:38.809761 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8b65889-fa7b-487c-96cf-a6ff942a4cf2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:39.110866 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e8b65889-fa7b-487c-96cf-a6ff942a4cf2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:39.127413 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e8b65889-fa7b-487c-96cf-a6ff942a4cf2 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.336715 Nov 24 03:05:39.128834 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 123/272] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:38 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:39.678548 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d8f1cfa4-94a9-4f67-8672-bdea6f2d436f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:39.679248 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d8f1cfa4-94a9-4f67-8672-bdea6f2d436f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:39.689094 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d8f1cfa4-94a9-4f67-8672-bdea6f2d436f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:39.689543 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d8f1cfa4-94a9-4f67-8672-bdea6f2d436f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:39.690386 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d8f1cfa4-94a9-4f67-8672-bdea6f2d436f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:39.690823 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d8f1cfa4-94a9-4f67-8672-bdea6f2d436f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:39.867943 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d8f1cfa4-94a9-4f67-8672-bdea6f2d436f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:39.875941 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d8f1cfa4-94a9-4f67-8672-bdea6f2d436f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1362 microversion: 2.1 time: 0.200945 Nov 24 03:05:39.876919 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 124/273] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:39 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:39.882775 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-337990ca-e3c2-4098-9668-5798d6cc3e19 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:39.884296 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-337990ca-e3c2-4098-9668-5798d6cc3e19 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:39.891619 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-337990ca-e3c2-4098-9668-5798d6cc3e19 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:39.892184 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-337990ca-e3c2-4098-9668-5798d6cc3e19 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:39.893582 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-337990ca-e3c2-4098-9668-5798d6cc3e19 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:39.894207 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-337990ca-e3c2-4098-9668-5798d6cc3e19 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:39.978233 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-337990ca-e3c2-4098-9668-5798d6cc3e19 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 38207 microversion: 2.20 time: 0.098993 Nov 24 03:05:39.979172 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 125/274] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:39 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 38207 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:40.159482 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-00467746-d914-43a0-98d7-c5f0f50941fa tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:40.161655 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-00467746-d914-43a0-98d7-c5f0f50941fa tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:40.175560 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-00467746-d914-43a0-98d7-c5f0f50941fa tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:40.176519 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-00467746-d914-43a0-98d7-c5f0f50941fa tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:40.181510 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-00467746-d914-43a0-98d7-c5f0f50941fa tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:40.182762 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-00467746-d914-43a0-98d7-c5f0f50941fa tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:40.404051 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-00467746-d914-43a0-98d7-c5f0f50941fa tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:40.415861 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-00467746-d914-43a0-98d7-c5f0f50941fa tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.271025 Nov 24 03:05:40.428903 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 126/275] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:40 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:40.894808 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-73d44b05-e4a5-43bf-a36e-e5d1989c3341 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:40.895518 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-73d44b05-e4a5-43bf-a36e-e5d1989c3341 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:40.905639 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-73d44b05-e4a5-43bf-a36e-e5d1989c3341 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:40.906146 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-73d44b05-e4a5-43bf-a36e-e5d1989c3341 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:40.907456 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-73d44b05-e4a5-43bf-a36e-e5d1989c3341 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:40.907901 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-73d44b05-e4a5-43bf-a36e-e5d1989c3341 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:41.184736 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-73d44b05-e4a5-43bf-a36e-e5d1989c3341 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:41.199012 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-73d44b05-e4a5-43bf-a36e-e5d1989c3341 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1362 microversion: 2.1 time: 0.310035 Nov 24 03:05:41.199714 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 127/276] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:40 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:05:41.225421 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-ab98a7b9-6df0-4990-84df-0e3493efddc6 req-3a0ef8b0-130d-4112-85e9-fc0b292c0209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9b822e-b442-450a-acaa-df8261422f50", "name": "network-vif-plugged", "status": "completed", "tag": "c3568a99-3dfd-41f8-9643-ad9aa328f79e"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:41.228857 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:05:41.228857 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:05:41.248309 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-ab98a7b9-6df0-4990-84df-0e3493efddc6 req-3a0ef8b0-130d-4112-85e9-fc0b292c0209 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:41.249378 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-ab98a7b9-6df0-4990-84df-0e3493efddc6 req-3a0ef8b0-130d-4112-85e9-fc0b292c0209 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:41.266634 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-ab98a7b9-6df0-4990-84df-0e3493efddc6 req-3a0ef8b0-130d-4112-85e9-fc0b292c0209 service nova] Creating event network-vif-plugged:c3568a99-3dfd-41f8-9643-ad9aa328f79e for instance dd9b822e-b442-450a-acaa-df8261422f50 on hv-cinder-81803 Nov 24 03:05:41.277404 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-ab98a7b9-6df0-4990-84df-0e3493efddc6 req-3a0ef8b0-130d-4112-85e9-fc0b292c0209 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075401 Nov 24 03:05:41.278378 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 128/277] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:05:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:05:41.285622 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-36a3258c-5c58-46f6-840c-8224c6766937 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:41.297855 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-36a3258c-5c58-46f6-840c-8224c6766937 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:41.312801 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36a3258c-5c58-46f6-840c-8224c6766937 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:41.314357 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36a3258c-5c58-46f6-840c-8224c6766937 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:41.315668 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36a3258c-5c58-46f6-840c-8224c6766937 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:41.316279 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36a3258c-5c58-46f6-840c-8224c6766937 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:41.423084 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-36a3258c-5c58-46f6-840c-8224c6766937 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 38207 microversion: 2.20 time: 0.142438 Nov 24 03:05:41.439333 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 129/278] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:41 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 38207 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:41.447296 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ec6b0d68-a50e-4a33-b792-adef1b932289 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:41.459436 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ec6b0d68-a50e-4a33-b792-adef1b932289 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:41.477176 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ec6b0d68-a50e-4a33-b792-adef1b932289 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:41.496677 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ec6b0d68-a50e-4a33-b792-adef1b932289 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:41.497600 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ec6b0d68-a50e-4a33-b792-adef1b932289 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:41.498224 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ec6b0d68-a50e-4a33-b792-adef1b932289 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:42.224443 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ec6b0d68-a50e-4a33-b792-adef1b932289 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:42.232328 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ec6b0d68-a50e-4a33-b792-adef1b932289 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.791491 Nov 24 03:05:42.232830 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 130/279] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:41 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:42.239463 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7491ccf0-63b1-4ef6-8fbd-bd2f50111fae tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:42.241310 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7491ccf0-63b1-4ef6-8fbd-bd2f50111fae tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:42.250156 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7491ccf0-63b1-4ef6-8fbd-bd2f50111fae tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:42.250656 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7491ccf0-63b1-4ef6-8fbd-bd2f50111fae tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:42.251428 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7491ccf0-63b1-4ef6-8fbd-bd2f50111fae tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:42.256613 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7491ccf0-63b1-4ef6-8fbd-bd2f50111fae tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:42.552711 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7491ccf0-63b1-4ef6-8fbd-bd2f50111fae tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:42.580515 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7491ccf0-63b1-4ef6-8fbd-bd2f50111fae tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1362 microversion: 2.1 time: 0.345391 Nov 24 03:05:42.582694 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 131/280] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:42 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:42.592610 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5056a8ef-112c-4a71-bc8f-b1b1dd98d68a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:42.594904 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5056a8ef-112c-4a71-bc8f-b1b1dd98d68a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:42.601675 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5056a8ef-112c-4a71-bc8f-b1b1dd98d68a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:42.602160 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5056a8ef-112c-4a71-bc8f-b1b1dd98d68a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:42.603581 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5056a8ef-112c-4a71-bc8f-b1b1dd98d68a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:42.603581 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5056a8ef-112c-4a71-bc8f-b1b1dd98d68a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:42.711062 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5056a8ef-112c-4a71-bc8f-b1b1dd98d68a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 200 len: 38347 microversion: 2.20 time: 0.125487 Nov 24 03:05:42.720085 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 132/281] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:42 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 38347 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:42.727938 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-716cc530-74d8-4e5e-ad15-e3890bad6ad7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:42.728820 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-716cc530-74d8-4e5e-ad15-e3890bad6ad7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:42.739962 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-716cc530-74d8-4e5e-ad15-e3890bad6ad7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:42.740516 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-716cc530-74d8-4e5e-ad15-e3890bad6ad7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:42.742237 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-716cc530-74d8-4e5e-ad15-e3890bad6ad7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:42.742937 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-716cc530-74d8-4e5e-ad15-e3890bad6ad7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:42.816422 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-716cc530-74d8-4e5e-ad15-e3890bad6ad7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/ips" status: 200 len: 152 microversion: 2.20 time: 0.095089 Nov 24 03:05:42.835162 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 133/282] 10.222.0.52 () {60 vars in 1288 bytes} [Wed Nov 24 03:05:42 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/ips => generated 152 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:05:43.250563 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7359527f-0fb4-4bfd-9bff-8197be6c75b5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:43.251508 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7359527f-0fb4-4bfd-9bff-8197be6c75b5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:43.262744 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7359527f-0fb4-4bfd-9bff-8197be6c75b5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:43.263209 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7359527f-0fb4-4bfd-9bff-8197be6c75b5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:43.264063 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7359527f-0fb4-4bfd-9bff-8197be6c75b5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:43.264499 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7359527f-0fb4-4bfd-9bff-8197be6c75b5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:43.793436 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7359527f-0fb4-4bfd-9bff-8197be6c75b5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:43.804827 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7359527f-0fb4-4bfd-9bff-8197be6c75b5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.558368 Nov 24 03:05:43.805738 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 134/283] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:43 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:05:43.834637 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6a245bef-cda7-4b29-8890-208a3e7b14a6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:43.835326 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6a245bef-cda7-4b29-8890-208a3e7b14a6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:43.849864 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6a245bef-cda7-4b29-8890-208a3e7b14a6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:43.851261 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6a245bef-cda7-4b29-8890-208a3e7b14a6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:43.853743 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6a245bef-cda7-4b29-8890-208a3e7b14a6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:43.854844 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6a245bef-cda7-4b29-8890-208a3e7b14a6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:44.208236 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6a245bef-cda7-4b29-8890-208a3e7b14a6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:44.216622 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6a245bef-cda7-4b29-8890-208a3e7b14a6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1362 microversion: 2.1 time: 0.396993 Nov 24 03:05:44.217235 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 135/284] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:43 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:44.825274 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0b2d7fb7-332b-44ea-b82d-53a9ba45d5dc tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:44.825974 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0b2d7fb7-332b-44ea-b82d-53a9ba45d5dc tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:44.835005 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b2d7fb7-332b-44ea-b82d-53a9ba45d5dc tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:44.835495 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b2d7fb7-332b-44ea-b82d-53a9ba45d5dc tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:44.836326 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b2d7fb7-332b-44ea-b82d-53a9ba45d5dc tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:44.836773 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b2d7fb7-332b-44ea-b82d-53a9ba45d5dc tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:45.010067 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0b2d7fb7-332b-44ea-b82d-53a9ba45d5dc tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:45.018795 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0b2d7fb7-332b-44ea-b82d-53a9ba45d5dc tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.196867 Nov 24 03:05:45.019379 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 136/285] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:44 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:45.024223 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-774ea33b-191e-4ac2-8d3e-67a443c509c9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ceaa78e8-bb98-424a-8f8d-29c08415bd46"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:45.025287 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-774ea33b-191e-4ac2-8d3e-67a443c509c9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:45.031358 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-774ea33b-191e-4ac2-8d3e-67a443c509c9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:45.032503 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-774ea33b-191e-4ac2-8d3e-67a443c509c9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:45.033304 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-774ea33b-191e-4ac2-8d3e-67a443c509c9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:45.033945 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-774ea33b-191e-4ac2-8d3e-67a443c509c9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:45.119539 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-774ea33b-191e-4ac2-8d3e-67a443c509c9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] HTTP exception thrown: Invalid volume: volume ceaa78e8-bb98-424a-8f8d-29c08415bd46 is already attached to instances: d57fe44d-e7d6-4188-b8aa-343ca2963f68 Nov 24 03:05:45.120453 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-774ea33b-191e-4ac2-8d3e-67a443c509c9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Returning 400 to user: Invalid volume: volume ceaa78e8-bb98-424a-8f8d-29c08415bd46 is already attached to instances: d57fe44d-e7d6-4188-b8aa-343ca2963f68 {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:05:45.121509 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-774ea33b-191e-4ac2-8d3e-67a443c509c9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "POST /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101048 Nov 24 03:05:45.126931 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 137/286] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Nov 24 03:05:45 2021] POST /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 24 03:05:45.200096 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a873c247-a9b8-4848-959e-6f5b81df837d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:45.200748 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a873c247-a9b8-4848-959e-6f5b81df837d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:45.208534 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a873c247-a9b8-4848-959e-6f5b81df837d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:45.208987 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a873c247-a9b8-4848-959e-6f5b81df837d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:45.209953 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a873c247-a9b8-4848-959e-6f5b81df837d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:45.210415 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a873c247-a9b8-4848-959e-6f5b81df837d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:45.355850 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-a873c247-a9b8-4848-959e-6f5b81df837d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lazy-loading 'services' on Instance uuid d57fe44d-e7d6-4188-b8aa-343ca2963f68 {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:05:45.499734 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a873c247-a9b8-4848-959e-6f5b81df837d tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68/os-volume_attachments/ceaa78e8-bb98-424a-8f8d-29c08415bd46" status: 202 len: 0 microversion: 2.1 time: 0.303183 Nov 24 03:05:45.501255 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 138/287] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Nov 24 03:05:45 2021] DELETE /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68/os-volume_attachments/ceaa78e8-bb98-424a-8f8d-29c08415bd46 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:05:45.507326 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-af7815de-b882-4144-8986-e8cc7530576d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:45.508335 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-af7815de-b882-4144-8986-e8cc7530576d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:45.515269 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-af7815de-b882-4144-8986-e8cc7530576d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:45.515775 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-af7815de-b882-4144-8986-e8cc7530576d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:45.516781 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-af7815de-b882-4144-8986-e8cc7530576d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:45.517262 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-af7815de-b882-4144-8986-e8cc7530576d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:45.709533 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-af7815de-b882-4144-8986-e8cc7530576d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:45.726067 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-af7815de-b882-4144-8986-e8cc7530576d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1549 microversion: 2.1 time: 0.223138 Nov 24 03:05:45.726661 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 139/288] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:45 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1549 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:45.731396 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-76ba0e1f-e89a-4240-a528-7faee12375a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:45.731933 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-76ba0e1f-e89a-4240-a528-7faee12375a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:45.738228 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76ba0e1f-e89a-4240-a528-7faee12375a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:45.738918 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76ba0e1f-e89a-4240-a528-7faee12375a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:45.739858 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76ba0e1f-e89a-4240-a528-7faee12375a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:45.740458 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76ba0e1f-e89a-4240-a528-7faee12375a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:45.771072 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-76ba0e1f-e89a-4240-a528-7faee12375a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lazy-loading 'flavor' on Instance uuid dfaf6d4e-4188-451d-8af8-32300d13ae2d {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:05:49.740042 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.network.neutron [None req-e397fb24-8fe2-4cd0-847d-8e71737bd23a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] validate_networks() for [('922d2004-5882-4bf8-8fc8-00da4513861f', None, None, None, None, None)] {{(pid=116331) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:05:49.969000 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-76ba0e1f-e89a-4240-a528-7faee12375a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 202 len: 0 microversion: 2.20 time: 4.241045 Nov 24 03:05:49.974672 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 140/289] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:05:45 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 0 bytes in 4247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:05:49.980078 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-12137b69-3a87-4228-8fec-b287cbbe567e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:49.981087 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-12137b69-3a87-4228-8fec-b287cbbe567e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:50.000020 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-12137b69-3a87-4228-8fec-b287cbbe567e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:50.000466 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-12137b69-3a87-4228-8fec-b287cbbe567e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:50.002703 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-12137b69-3a87-4228-8fec-b287cbbe567e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:50.003386 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-12137b69-3a87-4228-8fec-b287cbbe567e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:50.036536 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-12137b69-3a87-4228-8fec-b287cbbe567e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060479 Nov 24 03:05:50.037135 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 141/290] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Nov 24 03:05:49 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:05:50.046468 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-cafb0f00-1f0c-4292-a205-6005361e5b73 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:50.047081 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-cafb0f00-1f0c-4292-a205-6005361e5b73 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:50.056833 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cafb0f00-1f0c-4292-a205-6005361e5b73 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:50.057759 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cafb0f00-1f0c-4292-a205-6005361e5b73 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:50.059456 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cafb0f00-1f0c-4292-a205-6005361e5b73 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:50.060375 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cafb0f00-1f0c-4292-a205-6005361e5b73 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:50.197092 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-cafb0f00-1f0c-4292-a205-6005361e5b73 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.158317 Nov 24 03:05:50.197728 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 142/291] 10.222.0.52 () {58 vars in 1274 bytes} [Wed Nov 24 03:05:50 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:05:50.202560 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6f10d28e-059f-4f67-86d7-e727ba255314 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:50.203518 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6f10d28e-059f-4f67-86d7-e727ba255314 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:50.212183 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f10d28e-059f-4f67-86d7-e727ba255314 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:50.212656 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f10d28e-059f-4f67-86d7-e727ba255314 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:50.213433 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f10d28e-059f-4f67-86d7-e727ba255314 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:50.213863 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f10d28e-059f-4f67-86d7-e727ba255314 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:50.324948 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-e397fb24-8fe2-4cd0-847d-8e71737bd23a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Flavor limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:05:50.325372 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-e397fb24-8fe2-4cd0-847d-8e71737bd23a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Image limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:05:50.325901 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-e397fb24-8fe2-4cd0-847d-8e71737bd23a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Flavor pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:05:50.326431 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-e397fb24-8fe2-4cd0-847d-8e71737bd23a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Image pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:05:50.326732 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-e397fb24-8fe2-4cd0-847d-8e71737bd23a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:05:50.337254 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e397fb24-8fe2-4cd0-847d-8e71737bd23a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:50.338035 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e397fb24-8fe2-4cd0-847d-8e71737bd23a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:50.338810 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e397fb24-8fe2-4cd0-847d-8e71737bd23a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:50.339431 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e397fb24-8fe2-4cd0-847d-8e71737bd23a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:50.366136 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-e397fb24-8fe2-4cd0-847d-8e71737bd23a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Getting quotas for project 1168b5e9cbf2481b87e2941d66cc41e4. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:05:50.371082 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-e397fb24-8fe2-4cd0-847d-8e71737bd23a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Getting quotas for user 707b4994da624c5b8e3297fb747abd09 and project 1168b5e9cbf2481b87e2941d66cc41e4. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:05:50.383829 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e397fb24-8fe2-4cd0-847d-8e71737bd23a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Going to run 1 instances... {{(pid=116331) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:05:50.387179 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e397fb24-8fe2-4cd0-847d-8e71737bd23a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04860a4a-47c3-4532-865d-be6c9c493af7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:05:50.458167 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e397fb24-8fe2-4cd0-847d-8e71737bd23a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.062233 Nov 24 03:05:50.473683 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 150/292] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Nov 24 03:05:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 13079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 03:05:50.481047 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b8ad9db9-97e3-4906-ba26-cb29c2289c5b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:50.483591 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b8ad9db9-97e3-4906-ba26-cb29c2289c5b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:50.501349 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b8ad9db9-97e3-4906-ba26-cb29c2289c5b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:50.502602 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b8ad9db9-97e3-4906-ba26-cb29c2289c5b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:50.503923 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b8ad9db9-97e3-4906-ba26-cb29c2289c5b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:50.504753 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b8ad9db9-97e3-4906-ba26-cb29c2289c5b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:50.708037 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6f10d28e-059f-4f67-86d7-e727ba255314 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:50.716520 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b8ad9db9-97e3-4906-ba26-cb29c2289c5b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:50.716781 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6f10d28e-059f-4f67-86d7-e727ba255314 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.517655 Nov 24 03:05:50.717172 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 143/293] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:50 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:50.725619 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-598ccf56-92d0-478a-a4ec-7bdc9ced1119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-918269743", "imageRef": "04860a4a-47c3-4532-865d-be6c9c493af7", "flavorRef": "452", "networks": [{"uuid": "3f10594b-6f86-48fa-a7b0-505b247d8265"}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:50.730358 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b8ad9db9-97e3-4906-ba26-cb29c2289c5b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:50.734419 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b8ad9db9-97e3-4906-ba26-cb29c2289c5b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:50.737400 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b8ad9db9-97e3-4906-ba26-cb29c2289c5b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.262243 Nov 24 03:05:50.738337 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 151/294] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:05:50 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:05:50.743863 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-d6d328f4-ac87-49ec-b884-bcadd767fd5a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:50.745583 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-d6d328f4-ac87-49ec-b884-bcadd767fd5a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:50.830964 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-598ccf56-92d0-478a-a4ec-7bdc9ced1119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] validate_networks() for [('3f10594b-6f86-48fa-a7b0-505b247d8265', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:05:50.860983 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-d6d328f4-ac87-49ec-b884-bcadd767fd5a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:50.869657 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-d6d328f4-ac87-49ec-b884-bcadd767fd5a tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 200 len: 1214 microversion: 2.1 time: 0.129689 Nov 24 03:05:50.871219 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 152/295] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:50 2021] GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:51.738887 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-6ef16faf-db7a-4452-a8e7-ca1084e02c24 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:51.741228 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-6ef16faf-db7a-4452-a8e7-ca1084e02c24 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:51.759650 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6ef16faf-db7a-4452-a8e7-ca1084e02c24 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:51.766688 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6ef16faf-db7a-4452-a8e7-ca1084e02c24 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:51.769594 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6ef16faf-db7a-4452-a8e7-ca1084e02c24 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:51.770819 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6ef16faf-db7a-4452-a8e7-ca1084e02c24 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:52.092737 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-6ef16faf-db7a-4452-a8e7-ca1084e02c24 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:52.112749 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-6ef16faf-db7a-4452-a8e7-ca1084e02c24 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.378679 Nov 24 03:05:52.141038 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 153/296] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:51 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:05:52.152350 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-de567891-cf46-4c2f-9684-7807557ea852 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:52.153104 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-de567891-cf46-4c2f-9684-7807557ea852 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:52.172622 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-de567891-cf46-4c2f-9684-7807557ea852 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:52.173606 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-de567891-cf46-4c2f-9684-7807557ea852 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:52.175193 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-de567891-cf46-4c2f-9684-7807557ea852 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:52.175654 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-de567891-cf46-4c2f-9684-7807557ea852 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:52.253561 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-598ccf56-92d0-478a-a4ec-7bdc9ced1119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:05:52.254154 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-598ccf56-92d0-478a-a4ec-7bdc9ced1119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:05:52.254497 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-598ccf56-92d0-478a-a4ec-7bdc9ced1119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:05:52.254895 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-598ccf56-92d0-478a-a4ec-7bdc9ced1119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:05:52.255310 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-598ccf56-92d0-478a-a4ec-7bdc9ced1119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:05:52.267851 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-598ccf56-92d0-478a-a4ec-7bdc9ced1119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:52.269237 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-598ccf56-92d0-478a-a4ec-7bdc9ced1119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:52.272067 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-598ccf56-92d0-478a-a4ec-7bdc9ced1119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:52.273857 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-598ccf56-92d0-478a-a4ec-7bdc9ced1119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:52.302384 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-598ccf56-92d0-478a-a4ec-7bdc9ced1119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Getting quotas for project 0d8250c30ab9492ab167e4dd03c96be1. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:05:52.312354 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-598ccf56-92d0-478a-a4ec-7bdc9ced1119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Getting quotas for user 7721d1277c63459dacf166e44cacf3b5 and project 0d8250c30ab9492ab167e4dd03c96be1. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:05:52.344570 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-598ccf56-92d0-478a-a4ec-7bdc9ced1119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:05:52.347695 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-598ccf56-92d0-478a-a4ec-7bdc9ced1119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04860a4a-47c3-4532-865d-be6c9c493af7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:05:52.449805 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-598ccf56-92d0-478a-a4ec-7bdc9ced1119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.731529 Nov 24 03:05:52.450847 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 144/297] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Nov 24 03:05:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 03:05:52.455627 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-441b5548-164f-470b-93ea-b1a549aa801f tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:52.456248 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-441b5548-164f-470b-93ea-b1a549aa801f tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:52.487813 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-441b5548-164f-470b-93ea-b1a549aa801f tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:52.488298 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-441b5548-164f-470b-93ea-b1a549aa801f tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:52.489165 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-441b5548-164f-470b-93ea-b1a549aa801f tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:52.489608 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-441b5548-164f-470b-93ea-b1a549aa801f tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:52.586590 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-de567891-cf46-4c2f-9684-7807557ea852 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:52.603081 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-de567891-cf46-4c2f-9684-7807557ea852 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:52.604876 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-de567891-cf46-4c2f-9684-7807557ea852 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:52.610153 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-de567891-cf46-4c2f-9684-7807557ea852 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.463855 Nov 24 03:05:52.611140 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 154/298] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:05:52 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:05:52.620065 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e597026b-06c2-468e-bbda-fc9643ae88d0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:52.627957 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e597026b-06c2-468e-bbda-fc9643ae88d0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:52.674900 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-441b5548-164f-470b-93ea-b1a549aa801f tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:52.690658 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-441b5548-164f-470b-93ea-b1a549aa801f tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 200 len: 1272 microversion: 2.1 time: 0.238463 Nov 24 03:05:52.692474 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 145/299] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:52 2021] GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 1272 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:52.699344 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e597026b-06c2-468e-bbda-fc9643ae88d0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:52.707259 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e597026b-06c2-468e-bbda-fc9643ae88d0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28" status: 200 len: 1217 microversion: 2.1 time: 0.094610 Nov 24 03:05:52.707868 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 155/300] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:52 2021] GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:53.048077 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-cdde383d-a3fc-4c15-8e4e-2ee75fb12ead tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:53.049336 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-cdde383d-a3fc-4c15-8e4e-2ee75fb12ead tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:53.059502 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cdde383d-a3fc-4c15-8e4e-2ee75fb12ead tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:53.060013 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cdde383d-a3fc-4c15-8e4e-2ee75fb12ead tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:53.060877 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cdde383d-a3fc-4c15-8e4e-2ee75fb12ead tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:53.061315 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cdde383d-a3fc-4c15-8e4e-2ee75fb12ead tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:53.093661 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-4ea6b2ea-7c78-4bfa-8649-73fdf0a71b4b req-12bc86f1-e627-4071-ba51-44ed0d1cfdad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9b822e-b442-450a-acaa-df8261422f50", "tag": "c3568a99-3dfd-41f8-9643-ad9aa328f79e"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:53.101266 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:05:53.101266 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:05:53.131949 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-4ea6b2ea-7c78-4bfa-8649-73fdf0a71b4b req-12bc86f1-e627-4071-ba51-44ed0d1cfdad service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:53.138809 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-4ea6b2ea-7c78-4bfa-8649-73fdf0a71b4b req-12bc86f1-e627-4071-ba51-44ed0d1cfdad service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:53.171483 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-4ea6b2ea-7c78-4bfa-8649-73fdf0a71b4b req-12bc86f1-e627-4071-ba51-44ed0d1cfdad service nova] Creating event network-changed:c3568a99-3dfd-41f8-9643-ad9aa328f79e for instance dd9b822e-b442-450a-acaa-df8261422f50 on hv-cinder-81803 Nov 24 03:05:53.185511 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-4ea6b2ea-7c78-4bfa-8649-73fdf0a71b4b req-12bc86f1-e627-4071-ba51-44ed0d1cfdad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100560 Nov 24 03:05:53.188684 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 156/301] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:05:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:05:53.210168 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-742125a9-1b50-4075-9ef9-317d887c28b0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:53.211462 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-742125a9-1b50-4075-9ef9-317d887c28b0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:53.213793 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-cdde383d-a3fc-4c15-8e4e-2ee75fb12ead tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 14 microversion: 2.1 time: 0.169381 Nov 24 03:05:53.217130 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 146/302] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:05:53 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:05:53.223907 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-742125a9-1b50-4075-9ef9-317d887c28b0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:53.227038 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-742125a9-1b50-4075-9ef9-317d887c28b0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:53.245830 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-742125a9-1b50-4075-9ef9-317d887c28b0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:53.248446 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-742125a9-1b50-4075-9ef9-317d887c28b0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:53.630737 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ccdb3b63-1324-45c6-a7d3-b470b6ad9dc2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:53.631699 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ccdb3b63-1324-45c6-a7d3-b470b6ad9dc2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:53.661952 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ccdb3b63-1324-45c6-a7d3-b470b6ad9dc2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:53.669499 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ccdb3b63-1324-45c6-a7d3-b470b6ad9dc2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:53.671688 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ccdb3b63-1324-45c6-a7d3-b470b6ad9dc2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:53.674747 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ccdb3b63-1324-45c6-a7d3-b470b6ad9dc2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:53.748578 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-742125a9-1b50-4075-9ef9-317d887c28b0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:53.783580 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-742125a9-1b50-4075-9ef9-317d887c28b0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.592857 Nov 24 03:05:53.786729 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 157/303] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:53 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:53.808956 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-1ded895e-251c-450e-95b4-24f4b9e72602 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:53.812318 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-1ded895e-251c-450e-95b4-24f4b9e72602 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:53.843307 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1ded895e-251c-450e-95b4-24f4b9e72602 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:53.849003 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1ded895e-251c-450e-95b4-24f4b9e72602 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:53.856995 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1ded895e-251c-450e-95b4-24f4b9e72602 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:53.858174 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1ded895e-251c-450e-95b4-24f4b9e72602 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:54.395531 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ccdb3b63-1324-45c6-a7d3-b470b6ad9dc2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:54.444502 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ccdb3b63-1324-45c6-a7d3-b470b6ad9dc2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:54.453045 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ccdb3b63-1324-45c6-a7d3-b470b6ad9dc2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:54.457664 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ccdb3b63-1324-45c6-a7d3-b470b6ad9dc2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.832020 Nov 24 03:05:54.463048 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 147/304] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:05:53 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:05:54.480322 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6703bcf9-7bd1-4599-8122-8991e6513485 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:54.483154 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6703bcf9-7bd1-4599-8122-8991e6513485 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:54.505806 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6703bcf9-7bd1-4599-8122-8991e6513485 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:54.509152 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6703bcf9-7bd1-4599-8122-8991e6513485 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:54.512236 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6703bcf9-7bd1-4599-8122-8991e6513485 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:54.517015 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6703bcf9-7bd1-4599-8122-8991e6513485 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:54.801149 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-1ded895e-251c-450e-95b4-24f4b9e72602 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:54.812680 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-1ded895e-251c-450e-95b4-24f4b9e72602 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 200 len: 1314 microversion: 2.1 time: 1.020365 Nov 24 03:05:54.822173 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 158/305] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:53 2021] GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 1314 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:54.836892 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-d74bf12f-a071-4e43-8a25-aec32d4675c0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:54.849673 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-d74bf12f-a071-4e43-8a25-aec32d4675c0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:54.900798 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d74bf12f-a071-4e43-8a25-aec32d4675c0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:54.901828 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d74bf12f-a071-4e43-8a25-aec32d4675c0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:54.903217 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d74bf12f-a071-4e43-8a25-aec32d4675c0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:54.906562 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d74bf12f-a071-4e43-8a25-aec32d4675c0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:55.135269 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-d74bf12f-a071-4e43-8a25-aec32d4675c0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 14 microversion: 2.1 time: 0.295746 Nov 24 03:05:55.135630 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 159/306] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:05:54 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 14 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:05:55.183199 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-62517b83-eb15-4e42-b08f-5f1a2638f360 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:55.184624 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-62517b83-eb15-4e42-b08f-5f1a2638f360 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:55.204841 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-62517b83-eb15-4e42-b08f-5f1a2638f360 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:55.205288 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-62517b83-eb15-4e42-b08f-5f1a2638f360 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:55.216064 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-62517b83-eb15-4e42-b08f-5f1a2638f360 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:55.216972 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-62517b83-eb15-4e42-b08f-5f1a2638f360 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:55.334912 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6703bcf9-7bd1-4599-8122-8991e6513485 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:55.369905 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6703bcf9-7bd1-4599-8122-8991e6513485 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28" status: 200 len: 1277 microversion: 2.1 time: 0.904994 Nov 24 03:05:55.385950 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 148/307] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:54 2021] GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28 => generated 1277 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:55.497236 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1d027e06-3fea-4a1c-a2f8-aeae24b76045 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:55.500298 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1d027e06-3fea-4a1c-a2f8-aeae24b76045 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:55.547912 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-62517b83-eb15-4e42-b08f-5f1a2638f360 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:55.551066 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-62517b83-eb15-4e42-b08f-5f1a2638f360 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.409147 Nov 24 03:05:55.565675 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 160/308] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:55 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:55.596170 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d027e06-3fea-4a1c-a2f8-aeae24b76045 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:55.597386 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d027e06-3fea-4a1c-a2f8-aeae24b76045 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.046s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:55.600903 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d027e06-3fea-4a1c-a2f8-aeae24b76045 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:55.608852 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d027e06-3fea-4a1c-a2f8-aeae24b76045 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:55.840382 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f3da52d3-e5f1-4673-b173-9ddf5f1723c7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:55.841125 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f3da52d3-e5f1-4673-b173-9ddf5f1723c7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:55.850908 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f3da52d3-e5f1-4673-b173-9ddf5f1723c7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:55.851417 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f3da52d3-e5f1-4673-b173-9ddf5f1723c7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:55.852223 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f3da52d3-e5f1-4673-b173-9ddf5f1723c7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:55.852652 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f3da52d3-e5f1-4673-b173-9ddf5f1723c7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:56.085212 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1d027e06-3fea-4a1c-a2f8-aeae24b76045 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:56.094146 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1d027e06-3fea-4a1c-a2f8-aeae24b76045 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:56.096578 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1d027e06-3fea-4a1c-a2f8-aeae24b76045 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:56.097868 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1d027e06-3fea-4a1c-a2f8-aeae24b76045 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.618229 Nov 24 03:05:56.098527 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 149/309] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:05:55 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:05:56.145652 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c200ca3e-fb5d-4b70-bc70-b7ba0cca56f6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:56.146670 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c200ca3e-fb5d-4b70-bc70-b7ba0cca56f6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:56.155277 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c200ca3e-fb5d-4b70-bc70-b7ba0cca56f6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:56.155743 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c200ca3e-fb5d-4b70-bc70-b7ba0cca56f6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:56.157042 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c200ca3e-fb5d-4b70-bc70-b7ba0cca56f6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:56.157042 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c200ca3e-fb5d-4b70-bc70-b7ba0cca56f6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:56.171613 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f3da52d3-e5f1-4673-b173-9ddf5f1723c7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:56.186395 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f3da52d3-e5f1-4673-b173-9ddf5f1723c7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 200 len: 1314 microversion: 2.1 time: 0.349741 Nov 24 03:05:56.188996 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 161/310] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:55 2021] GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:56.263719 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c200ca3e-fb5d-4b70-bc70-b7ba0cca56f6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 14 microversion: 2.1 time: 0.121809 Nov 24 03:05:56.274254 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 150/311] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:05:56 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:05:56.351139 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-9ee7651d-6edb-421b-b516-d9cf88022b38 req-0a92cd4c-c6ac-4d5a-a40f-22f7d877d711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffab6a33-a901-4556-ba3b-3bddf9276d06", "tag": "29ea0772-b462-4e09-99be-8e865677581d"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:56.352893 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:05:56.352893 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:05:56.360892 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-9ee7651d-6edb-421b-b516-d9cf88022b38 req-0a92cd4c-c6ac-4d5a-a40f-22f7d877d711 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:56.371232 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-9ee7651d-6edb-421b-b516-d9cf88022b38 req-0a92cd4c-c6ac-4d5a-a40f-22f7d877d711 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:56.404111 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-02ac7772-909a-41ec-bf21-2d0b85d235b6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:56.406681 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-02ac7772-909a-41ec-bf21-2d0b85d235b6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:56.411611 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-9ee7651d-6edb-421b-b516-d9cf88022b38 req-0a92cd4c-c6ac-4d5a-a40f-22f7d877d711 service nova] Creating event network-changed:29ea0772-b462-4e09-99be-8e865677581d for instance ffab6a33-a901-4556-ba3b-3bddf9276d06 on hv-cinder-81803 Nov 24 03:05:56.425750 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-02ac7772-909a-41ec-bf21-2d0b85d235b6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:56.427793 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-9ee7651d-6edb-421b-b516-d9cf88022b38 req-0a92cd4c-c6ac-4d5a-a40f-22f7d877d711 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080457 Nov 24 03:05:56.430479 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-02ac7772-909a-41ec-bf21-2d0b85d235b6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:56.431737 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-02ac7772-909a-41ec-bf21-2d0b85d235b6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:56.435089 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 162/312] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:05:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:05:56.436167 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-02ac7772-909a-41ec-bf21-2d0b85d235b6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:56.573344 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-a8006b63-e55d-4a52-8459-1cffd28b96c1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:56.574282 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-a8006b63-e55d-4a52-8459-1cffd28b96c1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:56.584056 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a8006b63-e55d-4a52-8459-1cffd28b96c1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:56.588762 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a8006b63-e55d-4a52-8459-1cffd28b96c1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:56.592623 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a8006b63-e55d-4a52-8459-1cffd28b96c1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:56.593369 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a8006b63-e55d-4a52-8459-1cffd28b96c1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:56.916135 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-02ac7772-909a-41ec-bf21-2d0b85d235b6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:56.943684 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-02ac7772-909a-41ec-bf21-2d0b85d235b6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28" status: 200 len: 1317 microversion: 2.1 time: 0.532169 Nov 24 03:05:56.945730 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 151/313] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:56 2021] GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28 => generated 1317 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:57.117665 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-355e396c-befe-465c-b933-b6494d9aa0b7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:57.118650 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-355e396c-befe-465c-b933-b6494d9aa0b7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:57.131921 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-355e396c-befe-465c-b933-b6494d9aa0b7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:57.132843 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-355e396c-befe-465c-b933-b6494d9aa0b7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:57.136006 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-355e396c-befe-465c-b933-b6494d9aa0b7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:57.136727 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-355e396c-befe-465c-b933-b6494d9aa0b7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:57.283529 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-a8006b63-e55d-4a52-8459-1cffd28b96c1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:57.320668 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-a8006b63-e55d-4a52-8459-1cffd28b96c1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.752579 Nov 24 03:05:57.328102 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 163/314] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:56 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:05:57.347185 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-3d4b74bd-e6f4-43b9-8e5c-8770723e9d51 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:57.349231 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-3d4b74bd-e6f4-43b9-8e5c-8770723e9d51 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:57.366989 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3d4b74bd-e6f4-43b9-8e5c-8770723e9d51 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:57.370216 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3d4b74bd-e6f4-43b9-8e5c-8770723e9d51 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:57.374702 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3d4b74bd-e6f4-43b9-8e5c-8770723e9d51 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:57.377702 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3d4b74bd-e6f4-43b9-8e5c-8770723e9d51 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:57.518704 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-355e396c-befe-465c-b933-b6494d9aa0b7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:57.527190 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-355e396c-befe-465c-b933-b6494d9aa0b7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:57.531186 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-355e396c-befe-465c-b933-b6494d9aa0b7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:57.536306 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-355e396c-befe-465c-b933-b6494d9aa0b7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.422770 Nov 24 03:05:57.539207 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 152/315] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:05:57 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:05:57.551070 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4505e9ce-87be-4c12-9065-f8487ca803b6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:57.552440 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4505e9ce-87be-4c12-9065-f8487ca803b6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:57.562614 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4505e9ce-87be-4c12-9065-f8487ca803b6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:57.563652 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4505e9ce-87be-4c12-9065-f8487ca803b6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:57.565462 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4505e9ce-87be-4c12-9065-f8487ca803b6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:57.566205 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4505e9ce-87be-4c12-9065-f8487ca803b6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:57.670070 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4505e9ce-87be-4c12-9065-f8487ca803b6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 14 microversion: 2.1 time: 0.126808 Nov 24 03:05:57.675151 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 153/316] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:05:57 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:05:57.971283 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3c98baa7-e187-417e-9cb0-56ea8763bb06 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:57.972000 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3c98baa7-e187-417e-9cb0-56ea8763bb06 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:57.985619 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c98baa7-e187-417e-9cb0-56ea8763bb06 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:57.986115 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c98baa7-e187-417e-9cb0-56ea8763bb06 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:57.987211 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c98baa7-e187-417e-9cb0-56ea8763bb06 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:57.987650 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c98baa7-e187-417e-9cb0-56ea8763bb06 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:58.008885 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-3d4b74bd-e6f4-43b9-8e5c-8770723e9d51 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:58.024341 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-3d4b74bd-e6f4-43b9-8e5c-8770723e9d51 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 200 len: 1314 microversion: 2.1 time: 0.691486 Nov 24 03:05:58.026181 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 164/317] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:57 2021] GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:58.204022 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-dce1e572-fb3d-4909-b89c-0cd589a80a16 req-8a76d3d5-d8cd-4fd1-b704-ff92f9a0ac02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab488065-b4b5-481a-9a30-89acf3255d28", "tag": "c1b8a16d-4144-49ef-8026-f0477b55378f"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:58.206683 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:05:58.206683 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:05:58.222570 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-dce1e572-fb3d-4909-b89c-0cd589a80a16 req-8a76d3d5-d8cd-4fd1-b704-ff92f9a0ac02 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:58.225679 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-dce1e572-fb3d-4909-b89c-0cd589a80a16 req-8a76d3d5-d8cd-4fd1-b704-ff92f9a0ac02 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:58.263399 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-dce1e572-fb3d-4909-b89c-0cd589a80a16 req-8a76d3d5-d8cd-4fd1-b704-ff92f9a0ac02 service nova] Creating event network-changed:c1b8a16d-4144-49ef-8026-f0477b55378f for instance ab488065-b4b5-481a-9a30-89acf3255d28 on hv-cinder-81803 Nov 24 03:05:58.272430 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-dce1e572-fb3d-4909-b89c-0cd589a80a16 req-8a76d3d5-d8cd-4fd1-b704-ff92f9a0ac02 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074463 Nov 24 03:05:58.274153 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 165/318] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:05:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:05:58.349708 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f30cb6fd-07da-44a3-8fea-e0dc07407f7d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:58.351659 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f30cb6fd-07da-44a3-8fea-e0dc07407f7d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:58.361686 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f30cb6fd-07da-44a3-8fea-e0dc07407f7d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:58.362682 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f30cb6fd-07da-44a3-8fea-e0dc07407f7d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:58.363849 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f30cb6fd-07da-44a3-8fea-e0dc07407f7d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:58.364523 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f30cb6fd-07da-44a3-8fea-e0dc07407f7d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:58.661603 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3c98baa7-e187-417e-9cb0-56ea8763bb06 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:58.683661 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3c98baa7-e187-417e-9cb0-56ea8763bb06 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28" status: 200 len: 1317 microversion: 2.1 time: 0.716036 Nov 24 03:05:58.686112 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 154/319] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:57 2021] GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28 => generated 1317 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:05:58.699384 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-41bbf0ee-9bfc-4896-b9df-907ee06be40e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:58.700992 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-41bbf0ee-9bfc-4896-b9df-907ee06be40e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:58.713268 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-41bbf0ee-9bfc-4896-b9df-907ee06be40e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:58.717494 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-41bbf0ee-9bfc-4896-b9df-907ee06be40e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:58.719767 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-41bbf0ee-9bfc-4896-b9df-907ee06be40e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:58.720869 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-41bbf0ee-9bfc-4896-b9df-907ee06be40e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:58.744257 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f30cb6fd-07da-44a3-8fea-e0dc07407f7d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:58.755192 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f30cb6fd-07da-44a3-8fea-e0dc07407f7d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.414484 Nov 24 03:05:58.756380 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 166/320] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:58 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:05:58.764720 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-401bf087-fdcf-41ea-8fff-7fb698a678d1 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:58.770962 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-401bf087-fdcf-41ea-8fff-7fb698a678d1 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:58.785212 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-401bf087-fdcf-41ea-8fff-7fb698a678d1 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:58.785946 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-401bf087-fdcf-41ea-8fff-7fb698a678d1 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:58.786909 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-401bf087-fdcf-41ea-8fff-7fb698a678d1 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:58.787494 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-401bf087-fdcf-41ea-8fff-7fb698a678d1 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:58.897604 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-401bf087-fdcf-41ea-8fff-7fb698a678d1 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 14 microversion: 2.1 time: 0.136896 Nov 24 03:05:58.901640 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 167/321] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:05:58 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:05:58.958220 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-41bbf0ee-9bfc-4896-b9df-907ee06be40e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:58.971621 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-41bbf0ee-9bfc-4896-b9df-907ee06be40e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:58.973628 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-41bbf0ee-9bfc-4896-b9df-907ee06be40e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:58.976320 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-41bbf0ee-9bfc-4896-b9df-907ee06be40e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.288545 Nov 24 03:05:58.977499 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 155/322] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:05:58 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:05:59.042742 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-13070883-74df-4aa4-89c8-6fdcfafbe5e5 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:59.043714 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-13070883-74df-4aa4-89c8-6fdcfafbe5e5 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:59.052150 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-13070883-74df-4aa4-89c8-6fdcfafbe5e5 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:59.054978 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-13070883-74df-4aa4-89c8-6fdcfafbe5e5 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:59.056024 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-13070883-74df-4aa4-89c8-6fdcfafbe5e5 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:59.056767 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-13070883-74df-4aa4-89c8-6fdcfafbe5e5 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:59.322963 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-13070883-74df-4aa4-89c8-6fdcfafbe5e5 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:59.336721 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-13070883-74df-4aa4-89c8-6fdcfafbe5e5 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 200 len: 1314 microversion: 2.1 time: 0.297728 Nov 24 03:05:59.350566 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 168/323] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:59 2021] GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:59.711324 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-029df9f9-5e02-426c-af3c-465fc7346673 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:59.712115 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-029df9f9-5e02-426c-af3c-465fc7346673 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:59.720182 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-029df9f9-5e02-426c-af3c-465fc7346673 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:59.720750 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-029df9f9-5e02-426c-af3c-465fc7346673 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:59.721638 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-029df9f9-5e02-426c-af3c-465fc7346673 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:59.722174 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-029df9f9-5e02-426c-af3c-465fc7346673 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:59.773543 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2f949e87-fede-452b-80e1-7de8f6b02e37 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:05:59.774304 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2f949e87-fede-452b-80e1-7de8f6b02e37 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:59.785979 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2f949e87-fede-452b-80e1-7de8f6b02e37 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:59.786568 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2f949e87-fede-452b-80e1-7de8f6b02e37 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:59.787505 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2f949e87-fede-452b-80e1-7de8f6b02e37 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:59.788007 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2f949e87-fede-452b-80e1-7de8f6b02e37 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:59.954345 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-029df9f9-5e02-426c-af3c-465fc7346673 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:05:59.968109 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-029df9f9-5e02-426c-af3c-465fc7346673 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28" status: 200 len: 1317 microversion: 2.1 time: 0.260914 Nov 24 03:05:59.970435 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 156/324] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:59 2021] GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:05:59.976529 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-195103e5-9fc3-4d03-86e0-6c6508df2659 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:05:59.977839 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-195103e5-9fc3-4d03-86e0-6c6508df2659 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:05:59.985543 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-195103e5-9fc3-4d03-86e0-6c6508df2659 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:59.986497 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-195103e5-9fc3-4d03-86e0-6c6508df2659 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:05:59.987528 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-195103e5-9fc3-4d03-86e0-6c6508df2659 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:05:59.988157 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-195103e5-9fc3-4d03-86e0-6c6508df2659 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:00.004207 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2f949e87-fede-452b-80e1-7de8f6b02e37 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:00.012492 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2f949e87-fede-452b-80e1-7de8f6b02e37 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.242544 Nov 24 03:06:00.013681 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 169/325] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:05:59 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:00.035764 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b7f021d9-6805-49bc-9daa-e7489986f515 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:00.039769 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b7f021d9-6805-49bc-9daa-e7489986f515 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:00.049068 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b7f021d9-6805-49bc-9daa-e7489986f515 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:00.049799 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b7f021d9-6805-49bc-9daa-e7489986f515 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:00.050979 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b7f021d9-6805-49bc-9daa-e7489986f515 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:00.051435 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b7f021d9-6805-49bc-9daa-e7489986f515 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:00.090479 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-195103e5-9fc3-4d03-86e0-6c6508df2659 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 14 microversion: 2.1 time: 0.118397 Nov 24 03:06:00.091399 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 157/326] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:05:59 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:06:00.363872 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b7f021d9-6805-49bc-9daa-e7489986f515 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:00.369397 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8cf6bc4f-5464-4649-9221-1c9288b86159 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:00.370931 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8cf6bc4f-5464-4649-9221-1c9288b86159 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:00.373443 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b7f021d9-6805-49bc-9daa-e7489986f515 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:00.375142 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b7f021d9-6805-49bc-9daa-e7489986f515 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:00.376863 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b7f021d9-6805-49bc-9daa-e7489986f515 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.361745 Nov 24 03:06:00.377230 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 170/327] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:00 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:00.391096 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8cf6bc4f-5464-4649-9221-1c9288b86159 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:00.392000 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8cf6bc4f-5464-4649-9221-1c9288b86159 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:00.393592 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8cf6bc4f-5464-4649-9221-1c9288b86159 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:00.394262 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8cf6bc4f-5464-4649-9221-1c9288b86159 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:00.647475 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8cf6bc4f-5464-4649-9221-1c9288b86159 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:00.663266 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8cf6bc4f-5464-4649-9221-1c9288b86159 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 200 len: 1314 microversion: 2.1 time: 0.297054 Nov 24 03:06:00.664900 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 158/328] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:00 2021] GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:06:00.990179 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b60ada2f-d0a3-4b4f-bba3-712db55cf332 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:00.991450 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b60ada2f-d0a3-4b4f-bba3-712db55cf332 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:01.007153 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b60ada2f-d0a3-4b4f-bba3-712db55cf332 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:01.007153 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b60ada2f-d0a3-4b4f-bba3-712db55cf332 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:01.007153 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b60ada2f-d0a3-4b4f-bba3-712db55cf332 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:01.007153 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b60ada2f-d0a3-4b4f-bba3-712db55cf332 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:01.033577 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9654f506-49e3-47c3-ac01-a402c1f4410e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:01.034011 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9654f506-49e3-47c3-ac01-a402c1f4410e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:01.050420 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9654f506-49e3-47c3-ac01-a402c1f4410e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:01.051247 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9654f506-49e3-47c3-ac01-a402c1f4410e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:01.052077 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9654f506-49e3-47c3-ac01-a402c1f4410e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:01.052502 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9654f506-49e3-47c3-ac01-a402c1f4410e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:01.242359 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b60ada2f-d0a3-4b4f-bba3-712db55cf332 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:01.251810 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b60ada2f-d0a3-4b4f-bba3-712db55cf332 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28" status: 200 len: 1317 microversion: 2.1 time: 0.267555 Nov 24 03:06:01.255220 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 171/329] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:00 2021] GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:01.260294 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7f62d30a-ba1e-4cc3-9464-de73d5f2da74 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:01.261530 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-7f62d30a-ba1e-4cc3-9464-de73d5f2da74 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:01.269131 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7f62d30a-ba1e-4cc3-9464-de73d5f2da74 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:01.269871 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7f62d30a-ba1e-4cc3-9464-de73d5f2da74 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:01.270884 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7f62d30a-ba1e-4cc3-9464-de73d5f2da74 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:01.271467 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7f62d30a-ba1e-4cc3-9464-de73d5f2da74 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:01.289361 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9654f506-49e3-47c3-ac01-a402c1f4410e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:01.299486 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9654f506-49e3-47c3-ac01-a402c1f4410e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.271899 Nov 24 03:06:01.300766 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 159/330] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:01 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:01.353414 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7f62d30a-ba1e-4cc3-9464-de73d5f2da74 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 14 microversion: 2.1 time: 0.096327 Nov 24 03:06:01.354344 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 172/331] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:01 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:06:01.403688 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8960a0e9-00a6-4f05-b1a6-523a4ea52b88 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:01.404469 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8960a0e9-00a6-4f05-b1a6-523a4ea52b88 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:01.414631 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8960a0e9-00a6-4f05-b1a6-523a4ea52b88 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:01.418982 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8960a0e9-00a6-4f05-b1a6-523a4ea52b88 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:01.420107 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8960a0e9-00a6-4f05-b1a6-523a4ea52b88 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:01.420734 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8960a0e9-00a6-4f05-b1a6-523a4ea52b88 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:01.631997 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8960a0e9-00a6-4f05-b1a6-523a4ea52b88 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:01.646328 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8960a0e9-00a6-4f05-b1a6-523a4ea52b88 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:01.648075 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8960a0e9-00a6-4f05-b1a6-523a4ea52b88 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:01.649421 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8960a0e9-00a6-4f05-b1a6-523a4ea52b88 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.249837 Nov 24 03:06:01.650186 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 160/332] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:01 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:01.684899 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-fbc92f93-d8e3-423e-a928-23972efbdac8 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:01.690274 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-fbc92f93-d8e3-423e-a928-23972efbdac8 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:01.697894 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fbc92f93-d8e3-423e-a928-23972efbdac8 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:01.698911 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fbc92f93-d8e3-423e-a928-23972efbdac8 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:01.701190 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fbc92f93-d8e3-423e-a928-23972efbdac8 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:01.701825 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fbc92f93-d8e3-423e-a928-23972efbdac8 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:01.871161 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-fbc92f93-d8e3-423e-a928-23972efbdac8 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:01.880670 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-fbc92f93-d8e3-423e-a928-23972efbdac8 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 200 len: 1314 microversion: 2.1 time: 0.202462 Nov 24 03:06:01.881873 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 173/333] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:01 2021] GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:02.281125 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1924ec7d-2525-4a93-a08c-5d87935e591f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:02.285690 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1924ec7d-2525-4a93-a08c-5d87935e591f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:02.302742 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1924ec7d-2525-4a93-a08c-5d87935e591f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:02.304857 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1924ec7d-2525-4a93-a08c-5d87935e591f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:02.307107 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1924ec7d-2525-4a93-a08c-5d87935e591f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:02.308149 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1924ec7d-2525-4a93-a08c-5d87935e591f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:02.323830 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7dfde535-b690-43db-b3e5-3cb287ebc189 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:02.327840 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-7dfde535-b690-43db-b3e5-3cb287ebc189 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:02.360487 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7dfde535-b690-43db-b3e5-3cb287ebc189 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:02.361871 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7dfde535-b690-43db-b3e5-3cb287ebc189 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:02.365768 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7dfde535-b690-43db-b3e5-3cb287ebc189 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:02.367059 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7dfde535-b690-43db-b3e5-3cb287ebc189 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:02.687277 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7dfde535-b690-43db-b3e5-3cb287ebc189 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:02.710788 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7dfde535-b690-43db-b3e5-3cb287ebc189 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.396266 Nov 24 03:06:02.711998 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 174/334] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:02 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:02.737537 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c4537bd5-5a5d-49d3-83a1-15f756823d98 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:02.739355 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c4537bd5-5a5d-49d3-83a1-15f756823d98 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:02.751614 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c4537bd5-5a5d-49d3-83a1-15f756823d98 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:02.752701 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c4537bd5-5a5d-49d3-83a1-15f756823d98 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:02.754361 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c4537bd5-5a5d-49d3-83a1-15f756823d98 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:02.755378 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c4537bd5-5a5d-49d3-83a1-15f756823d98 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:02.850941 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c4537bd5-5a5d-49d3-83a1-15f756823d98 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 14 microversion: 2.1 time: 0.120729 Nov 24 03:06:02.852424 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 175/335] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:02 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:06:02.894850 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1924ec7d-2525-4a93-a08c-5d87935e591f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:02.899438 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-fae902f4-ae1b-4bd5-82c2-7c245b590e08 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:02.906890 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-fae902f4-ae1b-4bd5-82c2-7c245b590e08 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:02.911783 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1924ec7d-2525-4a93-a08c-5d87935e591f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28" status: 200 len: 1317 microversion: 2.1 time: 0.641301 Nov 24 03:06:02.915314 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 161/336] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:02 2021] GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28 => generated 1317 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:02.929472 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fe571cec-b04a-452e-be3b-50af8ad1408d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:02.930412 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fe571cec-b04a-452e-be3b-50af8ad1408d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:02.945615 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fe571cec-b04a-452e-be3b-50af8ad1408d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:02.946490 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fe571cec-b04a-452e-be3b-50af8ad1408d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:02.947561 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fe571cec-b04a-452e-be3b-50af8ad1408d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:02.948196 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fe571cec-b04a-452e-be3b-50af8ad1408d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:02.949924 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fae902f4-ae1b-4bd5-82c2-7c245b590e08 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:02.950752 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fae902f4-ae1b-4bd5-82c2-7c245b590e08 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:02.962586 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fae902f4-ae1b-4bd5-82c2-7c245b590e08 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:02.963609 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fae902f4-ae1b-4bd5-82c2-7c245b590e08 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:03.189233 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-fe571cec-b04a-452e-be3b-50af8ad1408d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:03.200204 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fe571cec-b04a-452e-be3b-50af8ad1408d tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 200 len: 1314 microversion: 2.1 time: 0.283409 Nov 24 03:06:03.201266 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 162/337] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:02 2021] GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:03.288154 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-fae902f4-ae1b-4bd5-82c2-7c245b590e08 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:03.323065 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-fae902f4-ae1b-4bd5-82c2-7c245b590e08 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:03.327927 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-fae902f4-ae1b-4bd5-82c2-7c245b590e08 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:03.330618 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-fae902f4-ae1b-4bd5-82c2-7c245b590e08 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.473217 Nov 24 03:06:03.331904 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 176/338] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:02 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:03.399526 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-40efc798-e490-41c0-b91b-e06cada3b2b0 req-6d8122ec-dd47-433e-a1a1-a0b2e1a0da14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffab6a33-a901-4556-ba3b-3bddf9276d06", "name": "network-vif-plugged", "status": "completed", "tag": "29ea0772-b462-4e09-99be-8e865677581d"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:03.405074 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:06:03.405074 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:06:03.424188 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-40efc798-e490-41c0-b91b-e06cada3b2b0 req-6d8122ec-dd47-433e-a1a1-a0b2e1a0da14 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:03.426854 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-40efc798-e490-41c0-b91b-e06cada3b2b0 req-6d8122ec-dd47-433e-a1a1-a0b2e1a0da14 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:03.456555 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-40efc798-e490-41c0-b91b-e06cada3b2b0 req-6d8122ec-dd47-433e-a1a1-a0b2e1a0da14 service nova] Creating event network-vif-plugged:29ea0772-b462-4e09-99be-8e865677581d for instance ffab6a33-a901-4556-ba3b-3bddf9276d06 on hv-cinder-81803 Nov 24 03:06:03.466248 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-40efc798-e490-41c0-b91b-e06cada3b2b0 req-6d8122ec-dd47-433e-a1a1-a0b2e1a0da14 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073769 Nov 24 03:06:03.467644 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 163/339] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:06:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:06:03.737642 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5d973a11-e62d-4e0c-bcba-dc013bb1c008 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:03.738940 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-5d973a11-e62d-4e0c-bcba-dc013bb1c008 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:03.749562 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5d973a11-e62d-4e0c-bcba-dc013bb1c008 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:03.750587 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5d973a11-e62d-4e0c-bcba-dc013bb1c008 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:03.753617 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5d973a11-e62d-4e0c-bcba-dc013bb1c008 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:03.754623 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5d973a11-e62d-4e0c-bcba-dc013bb1c008 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:03.869015 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-11f85142-c13d-45cb-bbd0-146277f30120 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:03.882330 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-11f85142-c13d-45cb-bbd0-146277f30120 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:03.906796 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-11f85142-c13d-45cb-bbd0-146277f30120 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:03.907891 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-11f85142-c13d-45cb-bbd0-146277f30120 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:03.909957 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-11f85142-c13d-45cb-bbd0-146277f30120 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:03.913025 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-11f85142-c13d-45cb-bbd0-146277f30120 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:04.039796 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-11f85142-c13d-45cb-bbd0-146277f30120 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 11371 microversion: 2.1 time: 0.178233 Nov 24 03:06:04.041181 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 164/340] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:03 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 11371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:06:04.051711 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f2e2201b-9645-4b44-a573-08ac86812119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:04.052745 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f2e2201b-9645-4b44-a573-08ac86812119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:04.061968 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f2e2201b-9645-4b44-a573-08ac86812119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:04.067654 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f2e2201b-9645-4b44-a573-08ac86812119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:04.069232 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f2e2201b-9645-4b44-a573-08ac86812119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:04.069970 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f2e2201b-9645-4b44-a573-08ac86812119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:04.105502 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5d973a11-e62d-4e0c-bcba-dc013bb1c008 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:04.116467 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-5d973a11-e62d-4e0c-bcba-dc013bb1c008 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.380996 Nov 24 03:06:04.117636 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 177/341] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:03 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:06:04.249380 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ea0b7976-3599-4487-9087-ad35df999725 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:04.250362 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ea0b7976-3599-4487-9087-ad35df999725 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:04.289222 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ea0b7976-3599-4487-9087-ad35df999725 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:04.296444 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ea0b7976-3599-4487-9087-ad35df999725 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:04.299440 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ea0b7976-3599-4487-9087-ad35df999725 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:04.299887 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f2e2201b-9645-4b44-a573-08ac86812119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:04.300399 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ea0b7976-3599-4487-9087-ad35df999725 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:04.308219 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f2e2201b-9645-4b44-a573-08ac86812119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28" status: 200 len: 1317 microversion: 2.1 time: 0.265579 Nov 24 03:06:04.315218 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 165/342] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:04 2021] GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:04.358545 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-071b14c6-178f-4683-899d-daec3ab234e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:04.359187 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-071b14c6-178f-4683-899d-daec3ab234e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:04.384164 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-071b14c6-178f-4683-899d-daec3ab234e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:04.385392 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-071b14c6-178f-4683-899d-daec3ab234e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:04.387533 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-071b14c6-178f-4683-899d-daec3ab234e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:04.389024 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-071b14c6-178f-4683-899d-daec3ab234e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:04.576239 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ea0b7976-3599-4487-9087-ad35df999725 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:04.604108 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ea0b7976-3599-4487-9087-ad35df999725 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 200 len: 1314 microversion: 2.1 time: 0.371401 Nov 24 03:06:04.605297 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 178/343] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:04 2021] GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:04.746131 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-071b14c6-178f-4683-899d-daec3ab234e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:04.766325 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-071b14c6-178f-4683-899d-daec3ab234e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:04.773332 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-071b14c6-178f-4683-899d-daec3ab234e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:04.776299 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-071b14c6-178f-4683-899d-daec3ab234e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.421358 Nov 24 03:06:04.778007 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 166/344] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:04 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:06:05.057162 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f1939fda-3c1a-41ef-b58f-6f6cc8280bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:05.060190 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f1939fda-3c1a-41ef-b58f-6f6cc8280bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:05.077501 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f1939fda-3c1a-41ef-b58f-6f6cc8280bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:05.079209 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f1939fda-3c1a-41ef-b58f-6f6cc8280bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:05.081078 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f1939fda-3c1a-41ef-b58f-6f6cc8280bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:05.082132 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f1939fda-3c1a-41ef-b58f-6f6cc8280bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:05.156346 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-76849604-8fec-47f4-aaa6-51c65318bd8e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:05.157428 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-76849604-8fec-47f4-aaa6-51c65318bd8e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:05.165539 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76849604-8fec-47f4-aaa6-51c65318bd8e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:05.166015 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76849604-8fec-47f4-aaa6-51c65318bd8e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:05.167414 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76849604-8fec-47f4-aaa6-51c65318bd8e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:05.167667 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76849604-8fec-47f4-aaa6-51c65318bd8e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:05.215704 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f1939fda-3c1a-41ef-b58f-6f6cc8280bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 15064 microversion: 2.1 time: 0.166431 Nov 24 03:06:05.216655 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 179/345] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:05 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 15064 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:06:05.357057 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-8b32fd43-618d-4cc6-babc-5bb149faa042 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:05.358259 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-8b32fd43-618d-4cc6-babc-5bb149faa042 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:05.364597 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-76849604-8fec-47f4-aaa6-51c65318bd8e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:05.365877 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8b32fd43-618d-4cc6-babc-5bb149faa042 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:05.366395 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8b32fd43-618d-4cc6-babc-5bb149faa042 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:05.367625 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8b32fd43-618d-4cc6-babc-5bb149faa042 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:05.368110 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8b32fd43-618d-4cc6-babc-5bb149faa042 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:05.374413 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-76849604-8fec-47f4-aaa6-51c65318bd8e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.234468 Nov 24 03:06:05.375029 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 167/346] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:05 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:05.615403 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-8b32fd43-618d-4cc6-babc-5bb149faa042 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:05.634916 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-8b32fd43-618d-4cc6-babc-5bb149faa042 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28" status: 200 len: 1317 microversion: 2.1 time: 0.296195 Nov 24 03:06:05.636713 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 180/347] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:05 2021] GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:05.648416 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ab9adf24-85a7-4b1d-873a-91faa46b4ba7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:05.649882 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ab9adf24-85a7-4b1d-873a-91faa46b4ba7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:05.667911 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab9adf24-85a7-4b1d-873a-91faa46b4ba7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:05.671732 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab9adf24-85a7-4b1d-873a-91faa46b4ba7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:05.674308 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab9adf24-85a7-4b1d-873a-91faa46b4ba7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:05.675525 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab9adf24-85a7-4b1d-873a-91faa46b4ba7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:05.806084 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-07e96502-fb05-42a6-a477-ccf955d746fd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:05.807419 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-07e96502-fb05-42a6-a477-ccf955d746fd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:05.823701 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-07e96502-fb05-42a6-a477-ccf955d746fd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:05.824381 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-07e96502-fb05-42a6-a477-ccf955d746fd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:05.825403 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-07e96502-fb05-42a6-a477-ccf955d746fd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:05.835936 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-07e96502-fb05-42a6-a477-ccf955d746fd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:05.887989 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ab9adf24-85a7-4b1d-873a-91faa46b4ba7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:05.897502 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ab9adf24-85a7-4b1d-873a-91faa46b4ba7 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 200 len: 1499 microversion: 2.1 time: 0.268638 Nov 24 03:06:05.906663 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 168/348] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:05 2021] GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 1499 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:06.075392 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-07e96502-fb05-42a6-a477-ccf955d746fd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:06.089324 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-07e96502-fb05-42a6-a477-ccf955d746fd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:06.092576 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-07e96502-fb05-42a6-a477-ccf955d746fd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:06.094153 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-07e96502-fb05-42a6-a477-ccf955d746fd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.292906 Nov 24 03:06:06.095125 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 181/349] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:05 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:06:06.131274 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c519ea55-7633-4449-86a5-8603d7a1185f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Action: 'create', calling method: .version_select at 0x7f7a2e841ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2076920807"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:06.153244 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-c519ea55-7633-4449-86a5-8603d7a1185f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Getting quotas for project 9bd704828d96416e8c51b5330f2e067e. Resources: {'key_pairs'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:06:06.158938 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-c519ea55-7633-4449-86a5-8603d7a1185f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Getting quotas for user b5757898fb3a467b8e5558d55906d6ed and project 9bd704828d96416e8c51b5330f2e067e. Resources: {'key_pairs'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:06:06.229931 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e5d92afd-d28c-43d0-b11c-0e0a8f0c49ee tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:06.231653 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e5d92afd-d28c-43d0-b11c-0e0a8f0c49ee tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:06.239900 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e5d92afd-d28c-43d0-b11c-0e0a8f0c49ee tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:06.240792 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e5d92afd-d28c-43d0-b11c-0e0a8f0c49ee tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:06.241976 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e5d92afd-d28c-43d0-b11c-0e0a8f0c49ee tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:06.242666 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e5d92afd-d28c-43d0-b11c-0e0a8f0c49ee tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:06.347358 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e5d92afd-d28c-43d0-b11c-0e0a8f0c49ee tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 17931 microversion: 2.1 time: 0.121065 Nov 24 03:06:06.348671 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 182/350] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:06 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 17931 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 03:06:06.365226 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-c519ea55-7633-4449-86a5-8603d7a1185f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Getting quotas for project 9bd704828d96416e8c51b5330f2e067e. Resources: {'key_pairs'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:06:06.368794 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-c519ea55-7633-4449-86a5-8603d7a1185f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Getting quotas for user b5757898fb3a467b8e5558d55906d6ed and project 9bd704828d96416e8c51b5330f2e067e. Resources: {'key_pairs'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:06:06.392447 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-64cfdb56-cfe6-4107-95e3-ee15356042de tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:06.394180 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-64cfdb56-cfe6-4107-95e3-ee15356042de tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:06.400898 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c519ea55-7633-4449-86a5-8603d7a1185f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.273671 Nov 24 03:06:06.401763 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 169/351] 10.222.0.52 () {60 vars in 1157 bytes} [Wed Nov 24 03:06:06 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:06.404224 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-64cfdb56-cfe6-4107-95e3-ee15356042de tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:06.405003 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-64cfdb56-cfe6-4107-95e3-ee15356042de tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:06.405824 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-64cfdb56-cfe6-4107-95e3-ee15356042de tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:06.409972 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-64cfdb56-cfe6-4107-95e3-ee15356042de tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:06.597741 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-034da091-650b-4564-a6c4-3776fffac6ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-804694271", "imageRef": "afc961cc-14ef-467f-87c0-2d149a63c8c6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2076920807", "networks": [{"uuid": "6ad7c3ab-8601-44ee-9183-a0916affd3e2"}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:06.633118 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-64cfdb56-cfe6-4107-95e3-ee15356042de tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:06.675787 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-64cfdb56-cfe6-4107-95e3-ee15356042de tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.287973 Nov 24 03:06:06.692183 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-034da091-650b-4564-a6c4-3776fffac6ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] validate_networks() for [('6ad7c3ab-8601-44ee-9183-a0916affd3e2', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:06:06.696451 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 183/352] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:06 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:06.706084 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e7beac80-8db8-432c-8b82-1a92d28ce0c5 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:06.707042 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e7beac80-8db8-432c-8b82-1a92d28ce0c5 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:06.715846 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e7beac80-8db8-432c-8b82-1a92d28ce0c5 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:06.716582 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e7beac80-8db8-432c-8b82-1a92d28ce0c5 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:06.719207 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e7beac80-8db8-432c-8b82-1a92d28ce0c5 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:06.720127 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e7beac80-8db8-432c-8b82-1a92d28ce0c5 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:06.798821 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e7beac80-8db8-432c-8b82-1a92d28ce0c5 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Going to try to terminate instance {{(pid=116331) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:06:06.949581 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e7beac80-8db8-432c-8b82-1a92d28ce0c5 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 204 len: 0 microversion: 2.1 time: 0.251201 Nov 24 03:06:06.950539 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 184/353] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:06:06 2021] DELETE /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:06:06.957461 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0a4f19a2-cb19-4474-98d8-21a8bd2d306c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:06.958505 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0a4f19a2-cb19-4474-98d8-21a8bd2d306c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:06.966282 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a4f19a2-cb19-4474-98d8-21a8bd2d306c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:06.967264 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a4f19a2-cb19-4474-98d8-21a8bd2d306c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:06.968415 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a4f19a2-cb19-4474-98d8-21a8bd2d306c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:06.968857 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a4f19a2-cb19-4474-98d8-21a8bd2d306c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:07.180632 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0a4f19a2-cb19-4474-98d8-21a8bd2d306c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:07.192250 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0a4f19a2-cb19-4474-98d8-21a8bd2d306c tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28" status: 200 len: 1317 microversion: 2.1 time: 0.237497 Nov 24 03:06:07.192920 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 185/354] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:06 2021] GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:07.198625 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-187aa7d2-d53c-47d8-b5e9-c77a0789fcb4 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:07.199341 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-187aa7d2-d53c-47d8-b5e9-c77a0789fcb4 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:07.207457 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-187aa7d2-d53c-47d8-b5e9-c77a0789fcb4 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:07.207817 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-187aa7d2-d53c-47d8-b5e9-c77a0789fcb4 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:07.208641 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-187aa7d2-d53c-47d8-b5e9-c77a0789fcb4 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:07.209055 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-187aa7d2-d53c-47d8-b5e9-c77a0789fcb4 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:07.408283 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-187aa7d2-d53c-47d8-b5e9-c77a0789fcb4 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:07.413757 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-034da091-650b-4564-a6c4-3776fffac6ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:06:07.415523 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-034da091-650b-4564-a6c4-3776fffac6ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:06:07.416510 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-034da091-650b-4564-a6c4-3776fffac6ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:06:07.417158 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-034da091-650b-4564-a6c4-3776fffac6ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:06:07.418336 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-034da091-650b-4564-a6c4-3776fffac6ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:06:07.430443 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-187aa7d2-d53c-47d8-b5e9-c77a0789fcb4 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 200 len: 1505 microversion: 2.1 time: 0.235262 Nov 24 03:06:07.437554 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-034da091-650b-4564-a6c4-3776fffac6ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:07.438673 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 186/355] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:07 2021] GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:07.439511 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-034da091-650b-4564-a6c4-3776fffac6ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:07.441253 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-034da091-650b-4564-a6c4-3776fffac6ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:07.442405 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-034da091-650b-4564-a6c4-3776fffac6ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:07.449749 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-dd582297-4697-48f3-9734-d9927c39d0fc req-113636cf-030d-4dce-980c-56343ec9525c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab488065-b4b5-481a-9a30-89acf3255d28", "name": "network-vif-plugged", "status": "completed", "tag": "c1b8a16d-4144-49ef-8026-f0477b55378f"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:07.455099 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:06:07.455099 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:06:07.462782 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-dd582297-4697-48f3-9734-d9927c39d0fc req-113636cf-030d-4dce-980c-56343ec9525c service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:07.463147 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-dd582297-4697-48f3-9734-d9927c39d0fc req-113636cf-030d-4dce-980c-56343ec9525c service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:07.471664 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-034da091-650b-4564-a6c4-3776fffac6ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Getting quotas for project 9bd704828d96416e8c51b5330f2e067e. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:06:07.476682 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-dd582297-4697-48f3-9734-d9927c39d0fc req-113636cf-030d-4dce-980c-56343ec9525c service nova] Creating event network-vif-plugged:c1b8a16d-4144-49ef-8026-f0477b55378f for instance ab488065-b4b5-481a-9a30-89acf3255d28 on hv-cinder-81803 Nov 24 03:06:07.482672 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-034da091-650b-4564-a6c4-3776fffac6ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Getting quotas for user b5757898fb3a467b8e5558d55906d6ed and project 9bd704828d96416e8c51b5330f2e067e. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:06:07.482957 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-dd582297-4697-48f3-9734-d9927c39d0fc req-113636cf-030d-4dce-980c-56343ec9525c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042753 Nov 24 03:06:07.483501 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 187/356] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:06:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:06:07.490190 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-8654a449-8c55-4cbf-bf17-54a81e3ed7ae tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:07.490903 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-8654a449-8c55-4cbf-bf17-54a81e3ed7ae tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:07.502412 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8654a449-8c55-4cbf-bf17-54a81e3ed7ae tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:07.502861 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8654a449-8c55-4cbf-bf17-54a81e3ed7ae tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:07.503866 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8654a449-8c55-4cbf-bf17-54a81e3ed7ae tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:07.504309 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8654a449-8c55-4cbf-bf17-54a81e3ed7ae tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:07.509115 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-034da091-650b-4564-a6c4-3776fffac6ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:06:07.511545 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-034da091-650b-4564-a6c4-3776fffac6ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='afc961cc-14ef-467f-87c0-2d149a63c8c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:06:07.585115 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-034da091-650b-4564-a6c4-3776fffac6ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996006 Nov 24 03:06:07.585799 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 170/357] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Nov 24 03:06:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 03:06:07.599796 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0341582f-b90d-4dd9-9504-d87b3c9a5f0b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:07.606421 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0341582f-b90d-4dd9-9504-d87b3c9a5f0b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:07.625212 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0341582f-b90d-4dd9-9504-d87b3c9a5f0b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:07.626256 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0341582f-b90d-4dd9-9504-d87b3c9a5f0b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:07.628637 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0341582f-b90d-4dd9-9504-d87b3c9a5f0b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:07.629768 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0341582f-b90d-4dd9-9504-d87b3c9a5f0b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:07.766099 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0341582f-b90d-4dd9-9504-d87b3c9a5f0b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 19342 microversion: 2.1 time: 0.176298 Nov 24 03:06:07.767623 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 171/358] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:07 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 19342 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:06:07.780748 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2f075fab-12c7-4ce4-9380-0095063c12ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:07.781469 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2f075fab-12c7-4ce4-9380-0095063c12ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:07.792353 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-8654a449-8c55-4cbf-bf17-54a81e3ed7ae tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:07.800780 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-8654a449-8c55-4cbf-bf17-54a81e3ed7ae tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:07.805092 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-8654a449-8c55-4cbf-bf17-54a81e3ed7ae tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:07.806601 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-8654a449-8c55-4cbf-bf17-54a81e3ed7ae tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.321688 Nov 24 03:06:07.807350 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 188/359] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:07 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:07.813840 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-60feecee-7a46-41fe-9a59-a781cb04df09 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:07.814817 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-60feecee-7a46-41fe-9a59-a781cb04df09 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:07.821641 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-60feecee-7a46-41fe-9a59-a781cb04df09 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:07.822508 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-60feecee-7a46-41fe-9a59-a781cb04df09 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:07.823666 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-60feecee-7a46-41fe-9a59-a781cb04df09 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:07.824280 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-60feecee-7a46-41fe-9a59-a781cb04df09 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:07.936131 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2f075fab-12c7-4ce4-9380-0095063c12ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:07.950869 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2f075fab-12c7-4ce4-9380-0095063c12ea tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1258 microversion: 2.1 time: 0.179970 Nov 24 03:06:07.952772 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 172/360] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:07 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1258 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:08.027485 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-60feecee-7a46-41fe-9a59-a781cb04df09 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:08.042311 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-60feecee-7a46-41fe-9a59-a781cb04df09 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.233387 Nov 24 03:06:08.044105 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 189/361] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:07 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:08.212589 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-18822cc8-22f6-402e-9c96-136ffdd589e8 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:08.213400 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-18822cc8-22f6-402e-9c96-136ffdd589e8 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:08.229200 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-18822cc8-22f6-402e-9c96-136ffdd589e8 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:08.230345 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-18822cc8-22f6-402e-9c96-136ffdd589e8 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:08.231615 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-18822cc8-22f6-402e-9c96-136ffdd589e8 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:08.232553 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-18822cc8-22f6-402e-9c96-136ffdd589e8 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:08.469033 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ffacf6b1-d4a9-43ae-977e-8222911fe11c tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:08.474006 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ffacf6b1-d4a9-43ae-977e-8222911fe11c tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:08.490006 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ffacf6b1-d4a9-43ae-977e-8222911fe11c tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:08.490895 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ffacf6b1-d4a9-43ae-977e-8222911fe11c tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:08.493339 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ffacf6b1-d4a9-43ae-977e-8222911fe11c tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:08.494210 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ffacf6b1-d4a9-43ae-977e-8222911fe11c tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:08.513382 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-18822cc8-22f6-402e-9c96-136ffdd589e8 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:08.529895 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-18822cc8-22f6-402e-9c96-136ffdd589e8 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28" status: 200 len: 1317 microversion: 2.1 time: 0.323517 Nov 24 03:06:08.530851 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 173/362] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:08 2021] GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:08.733301 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ffacf6b1-d4a9-43ae-977e-8222911fe11c tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:08.744798 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ffacf6b1-d4a9-43ae-977e-8222911fe11c tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 200 len: 1505 microversion: 2.1 time: 0.285382 Nov 24 03:06:08.745618 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 190/363] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:08 2021] GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:06:08.780091 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-26743e3d-d3e1-4ed4-8965-16ae29bc1635 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:08.781461 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-26743e3d-d3e1-4ed4-8965-16ae29bc1635 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:08.789954 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-26743e3d-d3e1-4ed4-8965-16ae29bc1635 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:08.790556 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-26743e3d-d3e1-4ed4-8965-16ae29bc1635 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:08.791498 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-26743e3d-d3e1-4ed4-8965-16ae29bc1635 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:08.792016 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-26743e3d-d3e1-4ed4-8965-16ae29bc1635 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:08.839549 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-34ff82a0-ed8e-41d8-bf06-64a520992c94 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:08.840696 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-34ff82a0-ed8e-41d8-bf06-64a520992c94 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:08.849603 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-34ff82a0-ed8e-41d8-bf06-64a520992c94 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:08.850469 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-34ff82a0-ed8e-41d8-bf06-64a520992c94 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:08.851470 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-34ff82a0-ed8e-41d8-bf06-64a520992c94 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:08.852134 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-34ff82a0-ed8e-41d8-bf06-64a520992c94 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:08.904751 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-26743e3d-d3e1-4ed4-8965-16ae29bc1635 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 20991 microversion: 2.1 time: 0.128071 Nov 24 03:06:08.905784 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 174/364] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:08 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 20991 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 03:06:08.973342 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-628b664d-f8d6-41c1-ac69-7ba15540d7ab tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:08.974371 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-628b664d-f8d6-41c1-ac69-7ba15540d7ab tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:08.981706 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-628b664d-f8d6-41c1-ac69-7ba15540d7ab tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:08.982176 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-628b664d-f8d6-41c1-ac69-7ba15540d7ab tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:08.983306 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-628b664d-f8d6-41c1-ac69-7ba15540d7ab tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:08.983747 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-628b664d-f8d6-41c1-ac69-7ba15540d7ab tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:09.012935 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-34ff82a0-ed8e-41d8-bf06-64a520992c94 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:09.022440 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-34ff82a0-ed8e-41d8-bf06-64a520992c94 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:09.024235 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-34ff82a0-ed8e-41d8-bf06-64a520992c94 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:09.025727 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-34ff82a0-ed8e-41d8-bf06-64a520992c94 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.192159 Nov 24 03:06:09.026326 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 191/365] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:08 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:09.061557 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e9cc9bb6-f246-43be-a91d-d7ed8a804067 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:09.062374 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e9cc9bb6-f246-43be-a91d-d7ed8a804067 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:09.072485 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e9cc9bb6-f246-43be-a91d-d7ed8a804067 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:09.072949 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e9cc9bb6-f246-43be-a91d-d7ed8a804067 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:09.073753 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e9cc9bb6-f246-43be-a91d-d7ed8a804067 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:09.074221 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e9cc9bb6-f246-43be-a91d-d7ed8a804067 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:09.079290 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-628b664d-f8d6-41c1-ac69-7ba15540d7ab tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:09.089027 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-628b664d-f8d6-41c1-ac69-7ba15540d7ab tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1310 microversion: 2.1 time: 0.121671 Nov 24 03:06:09.089982 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 175/366] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:08 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1310 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:06:09.456096 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e9cc9bb6-f246-43be-a91d-d7ed8a804067 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:09.467031 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e9cc9bb6-f246-43be-a91d-d7ed8a804067 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1501 microversion: 2.1 time: 0.409196 Nov 24 03:06:09.468836 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 192/367] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:09 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1501 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:09.500178 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-95c8436d-7b3d-411e-b97d-1242480023ab tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24ced077-22ec-4b1e-bd62-2a3933271358"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:09.503836 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-95c8436d-7b3d-411e-b97d-1242480023ab tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:09.519519 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-95c8436d-7b3d-411e-b97d-1242480023ab tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:09.520522 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-95c8436d-7b3d-411e-b97d-1242480023ab tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:09.520926 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-95c8436d-7b3d-411e-b97d-1242480023ab tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:09.521298 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-95c8436d-7b3d-411e-b97d-1242480023ab tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:09.552925 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-95c8436d-7b3d-411e-b97d-1242480023ab tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] HTTP exception thrown: Cannot 'attach_volume' instance 6bd67a95-85a5-4669-bc7b-2d50f1716c54 while it is in vm_state rescued Nov 24 03:06:09.554613 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-95c8436d-7b3d-411e-b97d-1242480023ab tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Returning 409 to user: Cannot 'attach_volume' instance 6bd67a95-85a5-4669-bc7b-2d50f1716c54 while it is in vm_state rescued {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:06:09.556247 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-95c8436d-7b3d-411e-b97d-1242480023ab tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "POST /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.067066 Nov 24 03:06:09.557794 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 176/368] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Nov 24 03:06:09 2021] POST /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/os-volume_attachments => generated 152 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 24 03:06:09.566222 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-09afad25-bc34-4439-8504-6f64efc499c0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:09.567233 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-09afad25-bc34-4439-8504-6f64efc499c0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:09.573887 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d292559f-152d-4258-bd60-a7ab30f2ba8d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:09.574467 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d292559f-152d-4258-bd60-a7ab30f2ba8d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:09.575411 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-09afad25-bc34-4439-8504-6f64efc499c0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:09.575868 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-09afad25-bc34-4439-8504-6f64efc499c0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:09.578537 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-09afad25-bc34-4439-8504-6f64efc499c0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:09.578537 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-09afad25-bc34-4439-8504-6f64efc499c0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:09.601495 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d292559f-152d-4258-bd60-a7ab30f2ba8d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:09.603045 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d292559f-152d-4258-bd60-a7ab30f2ba8d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:09.604202 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d292559f-152d-4258-bd60-a7ab30f2ba8d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:09.604668 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d292559f-152d-4258-bd60-a7ab30f2ba8d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:09.757995 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d292559f-152d-4258-bd60-a7ab30f2ba8d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "POST /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/action" status: 202 len: 0 microversion: 2.1 time: 0.186512 Nov 24 03:06:09.773578 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 177/369] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:09 2021] POST /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:06:09.794879 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9ea56b1b-5162-4ffa-a936-4a425adc4374 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:09.797134 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9ea56b1b-5162-4ffa-a936-4a425adc4374 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:09.811010 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ea56b1b-5162-4ffa-a936-4a425adc4374 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:09.811720 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ea56b1b-5162-4ffa-a936-4a425adc4374 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:09.812823 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ea56b1b-5162-4ffa-a936-4a425adc4374 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:09.813479 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ea56b1b-5162-4ffa-a936-4a425adc4374 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:10.212125 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9ea56b1b-5162-4ffa-a936-4a425adc4374 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:10.225578 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9ea56b1b-5162-4ffa-a936-4a425adc4374 tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 200 len: 1505 microversion: 2.1 time: 0.451041 Nov 24 03:06:10.233708 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 178/370] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:09 2021] GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 1505 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:10.254964 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7d072e48-f2b7-459d-9c0d-a392236f6c07 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:10.258599 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7d072e48-f2b7-459d-9c0d-a392236f6c07 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:10.276410 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d072e48-f2b7-459d-9c0d-a392236f6c07 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:10.277346 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d072e48-f2b7-459d-9c0d-a392236f6c07 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:10.278497 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d072e48-f2b7-459d-9c0d-a392236f6c07 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:10.279155 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d072e48-f2b7-459d-9c0d-a392236f6c07 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:10.383785 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-09afad25-bc34-4439-8504-6f64efc499c0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:10.393604 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-09afad25-bc34-4439-8504-6f64efc499c0 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28" status: 200 len: 1317 microversion: 2.1 time: 0.831407 Nov 24 03:06:10.410366 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 193/371] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:09 2021] GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28 => generated 1317 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:10.420550 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-571e87dc-83a9-464e-b552-0fd759bb4e46 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:10.422516 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-571e87dc-83a9-464e-b552-0fd759bb4e46 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:10.441250 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-571e87dc-83a9-464e-b552-0fd759bb4e46 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:10.442109 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-571e87dc-83a9-464e-b552-0fd759bb4e46 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:10.443160 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-571e87dc-83a9-464e-b552-0fd759bb4e46 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:10.443829 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-571e87dc-83a9-464e-b552-0fd759bb4e46 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:10.739616 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-571e87dc-83a9-464e-b552-0fd759bb4e46 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 23036 microversion: 2.1 time: 0.327520 Nov 24 03:06:10.754859 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 194/372] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:10 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 23036 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:06:10.782045 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5f624014-21ff-44db-ae1f-2c949e4aa72c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:10.783866 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-5f624014-21ff-44db-ae1f-2c949e4aa72c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:10.794230 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5f624014-21ff-44db-ae1f-2c949e4aa72c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:10.795114 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5f624014-21ff-44db-ae1f-2c949e4aa72c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:10.796354 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5f624014-21ff-44db-ae1f-2c949e4aa72c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:10.797289 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5f624014-21ff-44db-ae1f-2c949e4aa72c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:11.030241 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7d072e48-f2b7-459d-9c0d-a392236f6c07 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:11.039222 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7d072e48-f2b7-459d-9c0d-a392236f6c07 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1509 microversion: 2.1 time: 0.792607 Nov 24 03:06:11.043053 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 179/373] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:10 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1509 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:11.048905 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-05a8514f-99cf-4371-8718-cd87872b930e tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:11.051620 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-05a8514f-99cf-4371-8718-cd87872b930e tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:11.068014 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-05a8514f-99cf-4371-8718-cd87872b930e tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:11.068466 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-05a8514f-99cf-4371-8718-cd87872b930e tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:11.069601 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-05a8514f-99cf-4371-8718-cd87872b930e tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:11.070119 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-05a8514f-99cf-4371-8718-cd87872b930e tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:11.248519 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-05a8514f-99cf-4371-8718-cd87872b930e tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:11.260811 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-05a8514f-99cf-4371-8718-cd87872b930e tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1316 microversion: 2.1 time: 0.215102 Nov 24 03:06:11.261721 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 180/374] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:11 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:11.269363 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-200b4152-40d6-479d-9ed0-364353853eef tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:11.271167 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-200b4152-40d6-479d-9ed0-364353853eef tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:11.281231 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-200b4152-40d6-479d-9ed0-364353853eef tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:11.282440 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-200b4152-40d6-479d-9ed0-364353853eef tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:11.283474 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-200b4152-40d6-479d-9ed0-364353853eef tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:11.284466 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-200b4152-40d6-479d-9ed0-364353853eef tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:11.300425 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5f624014-21ff-44db-ae1f-2c949e4aa72c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:11.323840 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5f624014-21ff-44db-ae1f-2c949e4aa72c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:11.325454 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5f624014-21ff-44db-ae1f-2c949e4aa72c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:11.326787 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-5f624014-21ff-44db-ae1f-2c949e4aa72c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.568148 Nov 24 03:06:11.327403 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 195/375] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:10 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:11.418852 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-1a71ad69-b707-4b72-9b30-94b5e74e92da tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:11.420361 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-1a71ad69-b707-4b72-9b30-94b5e74e92da tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:11.435557 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1a71ad69-b707-4b72-9b30-94b5e74e92da tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:11.436701 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1a71ad69-b707-4b72-9b30-94b5e74e92da tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:11.438659 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1a71ad69-b707-4b72-9b30-94b5e74e92da tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:11.439661 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1a71ad69-b707-4b72-9b30-94b5e74e92da tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:11.496020 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-200b4152-40d6-479d-9ed0-364353853eef tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:11.506862 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-200b4152-40d6-479d-9ed0-364353853eef tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 200 len: 1463 microversion: 2.1 time: 0.243562 Nov 24 03:06:11.508876 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 181/376] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:11 2021] GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 1463 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:11.545738 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-b229b277-79ae-4d69-ba94-619df3fb5b35 req-656d53b7-03e6-4c72-9faa-4ed7f815838d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffab6a33-a901-4556-ba3b-3bddf9276d06", "name": "network-vif-deleted", "tag": "29ea0772-b462-4e09-99be-8e865677581d"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:11.547603 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:06:11.547603 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:06:11.556473 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-b229b277-79ae-4d69-ba94-619df3fb5b35 req-656d53b7-03e6-4c72-9faa-4ed7f815838d service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:11.557055 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-b229b277-79ae-4d69-ba94-619df3fb5b35 req-656d53b7-03e6-4c72-9faa-4ed7f815838d service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:11.573483 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-b229b277-79ae-4d69-ba94-619df3fb5b35 req-656d53b7-03e6-4c72-9faa-4ed7f815838d service nova] Creating event network-vif-deleted:29ea0772-b462-4e09-99be-8e865677581d for instance ffab6a33-a901-4556-ba3b-3bddf9276d06 on hv-cinder-81803 Nov 24 03:06:11.580122 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-b229b277-79ae-4d69-ba94-619df3fb5b35 req-656d53b7-03e6-4c72-9faa-4ed7f815838d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038090 Nov 24 03:06:11.584671 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 182/377] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:06:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:06:11.736919 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-1a71ad69-b707-4b72-9b30-94b5e74e92da tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:11.749090 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-1a71ad69-b707-4b72-9b30-94b5e74e92da tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28" status: 200 len: 1507 microversion: 2.1 time: 0.337815 Nov 24 03:06:11.749739 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 196/378] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:11 2021] GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28 => generated 1507 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:06:11.772502 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a98fbc72-ee04-428c-b253-7986e12dd773 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:11.773965 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a98fbc72-ee04-428c-b253-7986e12dd773 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:11.782825 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a98fbc72-ee04-428c-b253-7986e12dd773 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:11.783564 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a98fbc72-ee04-428c-b253-7986e12dd773 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:11.784621 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a98fbc72-ee04-428c-b253-7986e12dd773 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:11.785728 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a98fbc72-ee04-428c-b253-7986e12dd773 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:12.060570 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e88ad87a-2f6f-4319-a708-6f62a5faf132 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:12.061734 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e88ad87a-2f6f-4319-a708-6f62a5faf132 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:12.078038 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e88ad87a-2f6f-4319-a708-6f62a5faf132 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:12.079139 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e88ad87a-2f6f-4319-a708-6f62a5faf132 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:12.082616 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e88ad87a-2f6f-4319-a708-6f62a5faf132 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:12.083202 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e88ad87a-2f6f-4319-a708-6f62a5faf132 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:12.301751 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e88ad87a-2f6f-4319-a708-6f62a5faf132 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:12.310882 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e88ad87a-2f6f-4319-a708-6f62a5faf132 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1509 microversion: 2.1 time: 0.254725 Nov 24 03:06:12.311560 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 197/379] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:12 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:12.317719 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-91fc592d-c1cb-46cf-873e-0a4f97c213bc tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:12.318469 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-91fc592d-c1cb-46cf-873e-0a4f97c213bc tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:12.325898 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-91fc592d-c1cb-46cf-873e-0a4f97c213bc tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:12.326638 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-91fc592d-c1cb-46cf-873e-0a4f97c213bc tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:12.327621 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-91fc592d-c1cb-46cf-873e-0a4f97c213bc tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:12.328382 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-91fc592d-c1cb-46cf-873e-0a4f97c213bc tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:12.504347 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-91fc592d-c1cb-46cf-873e-0a4f97c213bc tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:12.515076 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-91fc592d-c1cb-46cf-873e-0a4f97c213bc tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1358 microversion: 2.1 time: 0.201911 Nov 24 03:06:12.516021 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 198/380] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:12 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:12.532193 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-68d29b13-5b06-41b6-bbe7-7f196c2e991d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:12.533178 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-68d29b13-5b06-41b6-bbe7-7f196c2e991d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:12.540624 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-68d29b13-5b06-41b6-bbe7-7f196c2e991d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:12.541072 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-68d29b13-5b06-41b6-bbe7-7f196c2e991d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:12.541856 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-68d29b13-5b06-41b6-bbe7-7f196c2e991d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:12.542317 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-68d29b13-5b06-41b6-bbe7-7f196c2e991d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:12.730693 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-68d29b13-5b06-41b6-bbe7-7f196c2e991d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:12.740341 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-68d29b13-5b06-41b6-bbe7-7f196c2e991d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:12.741945 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-68d29b13-5b06-41b6-bbe7-7f196c2e991d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:12.743315 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-68d29b13-5b06-41b6-bbe7-7f196c2e991d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.225606 Nov 24 03:06:12.745828 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 199/381] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:12 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:12.754418 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5bd3e38c-05e4-4de4-b484-1d76bbc1cb6e tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:12.755991 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-5bd3e38c-05e4-4de4-b484-1d76bbc1cb6e tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:12.765546 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5bd3e38c-05e4-4de4-b484-1d76bbc1cb6e tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:12.766588 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5bd3e38c-05e4-4de4-b484-1d76bbc1cb6e tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:12.768887 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5bd3e38c-05e4-4de4-b484-1d76bbc1cb6e tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:12.770163 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5bd3e38c-05e4-4de4-b484-1d76bbc1cb6e tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:12.848140 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5bd3e38c-05e4-4de4-b484-1d76bbc1cb6e tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:12.857482 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-5bd3e38c-05e4-4de4-b484-1d76bbc1cb6e tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 200 len: 1463 microversion: 2.1 time: 0.109720 Nov 24 03:06:12.858390 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 200/382] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:12 2021] GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 1463 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:13.331128 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5c0468a0-be6c-4393-a92a-544272a6392c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:13.331745 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-5c0468a0-be6c-4393-a92a-544272a6392c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:13.338801 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5c0468a0-be6c-4393-a92a-544272a6392c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:13.339205 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5c0468a0-be6c-4393-a92a-544272a6392c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:13.340005 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5c0468a0-be6c-4393-a92a-544272a6392c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:13.340616 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5c0468a0-be6c-4393-a92a-544272a6392c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:13.495451 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5c0468a0-be6c-4393-a92a-544272a6392c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:13.504347 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-5c0468a0-be6c-4393-a92a-544272a6392c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1509 microversion: 2.1 time: 0.179011 Nov 24 03:06:13.504940 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 201/383] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:13 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:06:13.544740 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-8d2e08cf-e4ea-49c1-b296-803e3545ee5d tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:13.545426 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-8d2e08cf-e4ea-49c1-b296-803e3545ee5d tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:13.552284 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8d2e08cf-e4ea-49c1-b296-803e3545ee5d tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:13.552731 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8d2e08cf-e4ea-49c1-b296-803e3545ee5d tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:13.553544 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8d2e08cf-e4ea-49c1-b296-803e3545ee5d tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:13.554004 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8d2e08cf-e4ea-49c1-b296-803e3545ee5d tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:13.776808 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-8d2e08cf-e4ea-49c1-b296-803e3545ee5d tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:13.785795 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-8d2e08cf-e4ea-49c1-b296-803e3545ee5d tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1358 microversion: 2.1 time: 0.244773 Nov 24 03:06:13.786494 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 202/384] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:13 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:06:13.791152 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f1ebd0d9-b8c1-4749-a0e5-6f29a2a3314e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:13.791773 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f1ebd0d9-b8c1-4749-a0e5-6f29a2a3314e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:13.799594 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f1ebd0d9-b8c1-4749-a0e5-6f29a2a3314e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:13.800045 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f1ebd0d9-b8c1-4749-a0e5-6f29a2a3314e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:13.800933 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f1ebd0d9-b8c1-4749-a0e5-6f29a2a3314e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:13.801340 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f1ebd0d9-b8c1-4749-a0e5-6f29a2a3314e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:14.008354 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f1ebd0d9-b8c1-4749-a0e5-6f29a2a3314e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:14.026621 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f1ebd0d9-b8c1-4749-a0e5-6f29a2a3314e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:14.028112 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f1ebd0d9-b8c1-4749-a0e5-6f29a2a3314e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:14.029633 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f1ebd0d9-b8c1-4749-a0e5-6f29a2a3314e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.241875 Nov 24 03:06:14.030233 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 203/385] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:13 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:14.047060 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-71acde9d-b7c0-4d5c-af2f-e9e9b6380fcb tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:14.047713 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-71acde9d-b7c0-4d5c-af2f-e9e9b6380fcb tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:14.056842 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-71acde9d-b7c0-4d5c-af2f-e9e9b6380fcb tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:14.057397 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-71acde9d-b7c0-4d5c-af2f-e9e9b6380fcb tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:14.058272 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-71acde9d-b7c0-4d5c-af2f-e9e9b6380fcb tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:14.058740 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-71acde9d-b7c0-4d5c-af2f-e9e9b6380fcb tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:14.131239 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-71acde9d-b7c0-4d5c-af2f-e9e9b6380fcb tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:14.146165 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-71acde9d-b7c0-4d5c-af2f-e9e9b6380fcb tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 200 len: 1463 microversion: 2.1 time: 0.114359 Nov 24 03:06:14.147534 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 204/386] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:14 2021] GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 1463 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:14.523187 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e6463fdd-2031-4134-be0b-e70b2955ba57 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:14.523807 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e6463fdd-2031-4134-be0b-e70b2955ba57 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:14.532314 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e6463fdd-2031-4134-be0b-e70b2955ba57 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:14.532786 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e6463fdd-2031-4134-be0b-e70b2955ba57 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:14.533618 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e6463fdd-2031-4134-be0b-e70b2955ba57 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:14.534101 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e6463fdd-2031-4134-be0b-e70b2955ba57 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:14.745074 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e6463fdd-2031-4134-be0b-e70b2955ba57 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:14.758978 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e6463fdd-2031-4134-be0b-e70b2955ba57 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1509 microversion: 2.1 time: 0.239664 Nov 24 03:06:14.760036 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 205/387] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:14 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1509 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:06:14.813642 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-be5fccbd-0697-498c-8485-31abd68edc3a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:14.814762 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-be5fccbd-0697-498c-8485-31abd68edc3a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:14.826264 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-be5fccbd-0697-498c-8485-31abd68edc3a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:14.826989 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-be5fccbd-0697-498c-8485-31abd68edc3a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:14.828325 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-be5fccbd-0697-498c-8485-31abd68edc3a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:14.829026 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-be5fccbd-0697-498c-8485-31abd68edc3a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:15.034152 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-be5fccbd-0697-498c-8485-31abd68edc3a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:15.042431 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-be5fccbd-0697-498c-8485-31abd68edc3a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1358 microversion: 2.1 time: 0.233798 Nov 24 03:06:15.043191 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 206/388] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:14 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:15.049782 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c4c9060b-3049-4bc2-af4e-f4dd74bde773 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:15.050429 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c4c9060b-3049-4bc2-af4e-f4dd74bde773 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:15.059944 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c4c9060b-3049-4bc2-af4e-f4dd74bde773 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:15.060496 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c4c9060b-3049-4bc2-af4e-f4dd74bde773 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:15.061409 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c4c9060b-3049-4bc2-af4e-f4dd74bde773 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:15.061956 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c4c9060b-3049-4bc2-af4e-f4dd74bde773 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:15.287651 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c4c9060b-3049-4bc2-af4e-f4dd74bde773 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:15.315001 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c4c9060b-3049-4bc2-af4e-f4dd74bde773 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:15.319622 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c4c9060b-3049-4bc2-af4e-f4dd74bde773 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:15.323712 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c4c9060b-3049-4bc2-af4e-f4dd74bde773 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.277080 Nov 24 03:06:15.336291 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 207/389] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:15 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:06:15.338536 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c555e89d-bc03-4fae-ad6e-6ea687bec56b tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:15.340587 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c555e89d-bc03-4fae-ad6e-6ea687bec56b tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:15.362523 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c555e89d-bc03-4fae-ad6e-6ea687bec56b tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:15.363034 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c555e89d-bc03-4fae-ad6e-6ea687bec56b tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:15.366435 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c555e89d-bc03-4fae-ad6e-6ea687bec56b tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:15.369611 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c555e89d-bc03-4fae-ad6e-6ea687bec56b tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:15.491051 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c555e89d-bc03-4fae-ad6e-6ea687bec56b tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707b4994da624c5b8e3297fb747abd09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168b5e9cbf2481b87e2941d66cc41e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:15.504216 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c555e89d-bc03-4fae-ad6e-6ea687bec56b tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 200 len: 1463 microversion: 2.1 time: 0.172086 Nov 24 03:06:15.514101 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 208/390] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:15 2021] GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 1463 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:15.523874 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ac73838c-c995-4e61-95cf-4ba1738f5ccd tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "360b6e07-26cb-47b5-a7f3-de18c8671caf"}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:15.525673 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ac73838c-c995-4e61-95cf-4ba1738f5ccd tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:15.547838 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ac73838c-c995-4e61-95cf-4ba1738f5ccd tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:15.548739 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ac73838c-c995-4e61-95cf-4ba1738f5ccd tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:15.549983 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ac73838c-c995-4e61-95cf-4ba1738f5ccd tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:15.550736 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ac73838c-c995-4e61-95cf-4ba1738f5ccd tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:23.454115 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a98fbc72-ee04-428c-b253-7986e12dd773 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 28457 microversion: 2.1 time: 11.689223 Nov 24 03:06:23.462411 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 183/391] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:11 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 28457 bytes in 11692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:06:23.468029 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a4d78aaa-8088-4d7d-9ce2-e54b21fa072a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:23.470477 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a4d78aaa-8088-4d7d-9ce2-e54b21fa072a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:23.481961 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a4d78aaa-8088-4d7d-9ce2-e54b21fa072a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:23.482859 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a4d78aaa-8088-4d7d-9ce2-e54b21fa072a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:23.484688 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a4d78aaa-8088-4d7d-9ce2-e54b21fa072a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:23.486259 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a4d78aaa-8088-4d7d-9ce2-e54b21fa072a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:23.996659 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ac73838c-c995-4e61-95cf-4ba1738f5ccd tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "POST /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.479825 Nov 24 03:06:24.005259 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 209/392] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Nov 24 03:06:15 2021] POST /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28/os-volume_attachments => generated 194 bytes in 8486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:06:24.044140 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-60f61ec1-44fb-483c-a8ca-e1a54f766132 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:24.050344 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-60f61ec1-44fb-483c-a8ca-e1a54f766132 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:24.099374 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-60f61ec1-44fb-483c-a8ca-e1a54f766132 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:24.110871 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-60f61ec1-44fb-483c-a8ca-e1a54f766132 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:24.113267 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-60f61ec1-44fb-483c-a8ca-e1a54f766132 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:24.116186 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-60f61ec1-44fb-483c-a8ca-e1a54f766132 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:24.146518 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a4d78aaa-8088-4d7d-9ce2-e54b21fa072a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:24.177241 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a4d78aaa-8088-4d7d-9ce2-e54b21fa072a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1509 microversion: 2.1 time: 0.716873 Nov 24 03:06:24.181604 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 184/393] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:23 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1509 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:24.200332 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f5635054-acbd-4fd0-9ee3-67da88e7923e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:24.209410 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f5635054-acbd-4fd0-9ee3-67da88e7923e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:24.247121 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f5635054-acbd-4fd0-9ee3-67da88e7923e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:24.248281 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f5635054-acbd-4fd0-9ee3-67da88e7923e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:24.257098 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f5635054-acbd-4fd0-9ee3-67da88e7923e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:24.261627 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f5635054-acbd-4fd0-9ee3-67da88e7923e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:24.683049 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f5635054-acbd-4fd0-9ee3-67da88e7923e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:24.717264 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f5635054-acbd-4fd0-9ee3-67da88e7923e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:24.720516 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f5635054-acbd-4fd0-9ee3-67da88e7923e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:24.728271 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f5635054-acbd-4fd0-9ee3-67da88e7923e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1745 microversion: 2.20 time: 0.539317 Nov 24 03:06:24.730688 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 185/394] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:24 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1745 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:24.754566 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c8441e10-20ea-4428-bfce-74a266299bbb tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:24.755947 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c8441e10-20ea-4428-bfce-74a266299bbb tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] [instance: ffab6a33-a901-4556-ba3b-3bddf9276d06] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:24.773037 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c8441e10-20ea-4428-bfce-74a266299bbb tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:24.779441 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c8441e10-20ea-4428-bfce-74a266299bbb tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:24.787903 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c8441e10-20ea-4428-bfce-74a266299bbb tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:24.792132 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c8441e10-20ea-4428-bfce-74a266299bbb tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:24.827859 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-c8441e10-20ea-4428-bfce-74a266299bbb tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] HTTP exception thrown: Instance ffab6a33-a901-4556-ba3b-3bddf9276d06 could not be found. Nov 24 03:06:24.829534 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c8441e10-20ea-4428-bfce-74a266299bbb tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] Returning 404 to user: Instance ffab6a33-a901-4556-ba3b-3bddf9276d06 could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:06:24.830772 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c8441e10-20ea-4428-bfce-74a266299bbb tempest-VolumesActionsTest-2141103267 tempest-VolumesActionsTest-2141103267-project] 10.222.0.52 "GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06" status: 404 len: 111 microversion: 2.1 time: 0.085596 Nov 24 03:06:24.831582 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 186/395] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:24 2021] GET /compute/v2.1/servers/ffab6a33-a901-4556-ba3b-3bddf9276d06 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:06:24.847040 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-37afbed4-89eb-4108-b10f-41950f083839 req-8d8dfcbb-f0f8-4bf1-8c71-c26bfd818cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfaf6d4e-4188-451d-8af8-32300d13ae2d", "name": "network-vif-plugged", "status": "completed", "tag": "521a966d-715d-42d8-a2e3-077f7788aac2"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:24.849737 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:06:24.849737 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:06:24.866827 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-37afbed4-89eb-4108-b10f-41950f083839 req-8d8dfcbb-f0f8-4bf1-8c71-c26bfd818cab service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:24.867766 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-37afbed4-89eb-4108-b10f-41950f083839 req-8d8dfcbb-f0f8-4bf1-8c71-c26bfd818cab service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:24.893603 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-37afbed4-89eb-4108-b10f-41950f083839 req-8d8dfcbb-f0f8-4bf1-8c71-c26bfd818cab service nova] Creating event network-vif-plugged:521a966d-715d-42d8-a2e3-077f7788aac2 for instance dfaf6d4e-4188-451d-8af8-32300d13ae2d on hv-cinder-81803 Nov 24 03:06:24.906365 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-37afbed4-89eb-4108-b10f-41950f083839 req-8d8dfcbb-f0f8-4bf1-8c71-c26bfd818cab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065806 Nov 24 03:06:24.908366 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 187/396] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:06:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:06:24.916036 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-63b8dece-9eda-4a61-87da-2c469e66368e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:24.917096 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-63b8dece-9eda-4a61-87da-2c469e66368e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:24.940487 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-63b8dece-9eda-4a61-87da-2c469e66368e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:24.943079 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-63b8dece-9eda-4a61-87da-2c469e66368e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:24.944120 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-63b8dece-9eda-4a61-87da-2c469e66368e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:24.947628 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-63b8dece-9eda-4a61-87da-2c469e66368e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:25.094463 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-63b8dece-9eda-4a61-87da-2c469e66368e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 28625 microversion: 2.1 time: 0.183529 Nov 24 03:06:25.102408 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 188/397] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:24 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 28625 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:06:25.214773 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0523c0e7-04fc-4ab2-818d-2c49a1f50f1f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:25.216855 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0523c0e7-04fc-4ab2-818d-2c49a1f50f1f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:25.249040 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0523c0e7-04fc-4ab2-818d-2c49a1f50f1f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:25.254904 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-60f61ec1-44fb-483c-a8ca-e1a54f766132 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:25.257774 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0523c0e7-04fc-4ab2-818d-2c49a1f50f1f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:25.259849 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0523c0e7-04fc-4ab2-818d-2c49a1f50f1f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:25.261882 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0523c0e7-04fc-4ab2-818d-2c49a1f50f1f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:25.280416 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-60f61ec1-44fb-483c-a8ca-e1a54f766132 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1358 microversion: 2.1 time: 1.277885 Nov 24 03:06:25.283975 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 210/398] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:24 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1358 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:25.482184 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0523c0e7-04fc-4ab2-818d-2c49a1f50f1f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:25.496570 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0523c0e7-04fc-4ab2-818d-2c49a1f50f1f tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1509 microversion: 2.1 time: 0.300257 Nov 24 03:06:25.508078 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 189/399] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:25 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1509 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:25.757788 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-3feca12a-1c40-401b-8a89-78206e119ed7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:25.766275 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-3feca12a-1c40-401b-8a89-78206e119ed7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:25.777156 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3feca12a-1c40-401b-8a89-78206e119ed7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:25.793409 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3feca12a-1c40-401b-8a89-78206e119ed7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:25.794908 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3feca12a-1c40-401b-8a89-78206e119ed7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:25.795650 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3feca12a-1c40-401b-8a89-78206e119ed7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:26.116610 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a7810311-5342-4bb9-9185-c2b4de976461 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:26.117680 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a7810311-5342-4bb9-9185-c2b4de976461 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:26.137450 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7810311-5342-4bb9-9185-c2b4de976461 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:26.152486 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7810311-5342-4bb9-9185-c2b4de976461 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:26.155276 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7810311-5342-4bb9-9185-c2b4de976461 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:26.159260 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7810311-5342-4bb9-9185-c2b4de976461 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:26.316588 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a7810311-5342-4bb9-9185-c2b4de976461 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 28625 microversion: 2.1 time: 0.203007 Nov 24 03:06:26.318232 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 190/400] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:26 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 28625 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:06:26.333311 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-cb25a382-5c20-4113-878d-7da6c70ee326 req-6f59fc69-df22-4d4b-a935-7fb8a97fc5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7751b5e-4ff9-4a10-be90-35dc8498899c", "tag": "2ece000a-104a-46f1-8ab6-c4772032c9cf"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:26.343494 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:06:26.343494 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:06:26.356621 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-cb25a382-5c20-4113-878d-7da6c70ee326 req-6f59fc69-df22-4d4b-a935-7fb8a97fc5f1 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:26.357540 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-cb25a382-5c20-4113-878d-7da6c70ee326 req-6f59fc69-df22-4d4b-a935-7fb8a97fc5f1 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:26.383707 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-cb25a382-5c20-4113-878d-7da6c70ee326 req-6f59fc69-df22-4d4b-a935-7fb8a97fc5f1 service nova] Creating event network-changed:2ece000a-104a-46f1-8ab6-c4772032c9cf for instance d7751b5e-4ff9-4a10-be90-35dc8498899c on hv-cinder-81803 Nov 24 03:06:26.391578 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-cb25a382-5c20-4113-878d-7da6c70ee326 req-6f59fc69-df22-4d4b-a935-7fb8a97fc5f1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070737 Nov 24 03:06:26.409638 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 191/401] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:06:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:06:26.418040 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6545e854-d39d-4432-8ac5-c9b8e8ed02c9 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:26.420366 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6545e854-d39d-4432-8ac5-c9b8e8ed02c9 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:26.440092 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6545e854-d39d-4432-8ac5-c9b8e8ed02c9 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:26.441227 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-3feca12a-1c40-401b-8a89-78206e119ed7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:26.442274 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6545e854-d39d-4432-8ac5-c9b8e8ed02c9 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:26.444012 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6545e854-d39d-4432-8ac5-c9b8e8ed02c9 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:26.445800 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6545e854-d39d-4432-8ac5-c9b8e8ed02c9 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:26.474656 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-3feca12a-1c40-401b-8a89-78206e119ed7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:26.478459 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-3feca12a-1c40-401b-8a89-78206e119ed7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:26.479753 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-3feca12a-1c40-401b-8a89-78206e119ed7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1745 microversion: 2.20 time: 0.730052 Nov 24 03:06:26.480369 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 211/402] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:25 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1745 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:26.525812 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b760773f-5ea8-4bb7-911e-56217d9027d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:26.529595 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b760773f-5ea8-4bb7-911e-56217d9027d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:26.542508 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b760773f-5ea8-4bb7-911e-56217d9027d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:26.542508 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b760773f-5ea8-4bb7-911e-56217d9027d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:26.543655 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b760773f-5ea8-4bb7-911e-56217d9027d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:26.545006 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b760773f-5ea8-4bb7-911e-56217d9027d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:26.769651 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6545e854-d39d-4432-8ac5-c9b8e8ed02c9 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:26.787221 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6545e854-d39d-4432-8ac5-c9b8e8ed02c9 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1358 microversion: 2.1 time: 0.374905 Nov 24 03:06:26.801950 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 192/403] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:26 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1358 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:27.033466 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b760773f-5ea8-4bb7-911e-56217d9027d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:27.046181 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b760773f-5ea8-4bb7-911e-56217d9027d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1509 microversion: 2.1 time: 0.526093 Nov 24 03:06:27.047295 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 212/404] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:26 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1509 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:27.335343 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-abfb338e-1c94-479d-9044-2d9a92d1a807 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:27.336852 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-abfb338e-1c94-479d-9044-2d9a92d1a807 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:27.361520 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-abfb338e-1c94-479d-9044-2d9a92d1a807 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:27.362348 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-abfb338e-1c94-479d-9044-2d9a92d1a807 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:27.363869 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-abfb338e-1c94-479d-9044-2d9a92d1a807 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:27.364677 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-abfb338e-1c94-479d-9044-2d9a92d1a807 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:27.500251 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c3ae90ec-b1e0-417d-b147-a67a36965c02 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:27.506348 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c3ae90ec-b1e0-417d-b147-a67a36965c02 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:27.517167 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c3ae90ec-b1e0-417d-b147-a67a36965c02 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:27.518794 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c3ae90ec-b1e0-417d-b147-a67a36965c02 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:27.520318 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c3ae90ec-b1e0-417d-b147-a67a36965c02 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:27.521099 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c3ae90ec-b1e0-417d-b147-a67a36965c02 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:27.838974 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c3ae90ec-b1e0-417d-b147-a67a36965c02 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:27.849663 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c3ae90ec-b1e0-417d-b147-a67a36965c02 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:27.851757 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c3ae90ec-b1e0-417d-b147-a67a36965c02 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:27.853316 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c3ae90ec-b1e0-417d-b147-a67a36965c02 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1745 microversion: 2.20 time: 0.358274 Nov 24 03:06:27.854674 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 213/405] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:27 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1745 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:06:27.860489 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2d2c9aad-c43b-41fb-bd0b-cffeeeb0c950 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:27.861714 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2d2c9aad-c43b-41fb-bd0b-cffeeeb0c950 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:27.869652 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2d2c9aad-c43b-41fb-bd0b-cffeeeb0c950 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:27.870581 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2d2c9aad-c43b-41fb-bd0b-cffeeeb0c950 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:27.871546 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2d2c9aad-c43b-41fb-bd0b-cffeeeb0c950 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:27.872174 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2d2c9aad-c43b-41fb-bd0b-cffeeeb0c950 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:28.409496 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2d2c9aad-c43b-41fb-bd0b-cffeeeb0c950 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:28.425477 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2d2c9aad-c43b-41fb-bd0b-cffeeeb0c950 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1358 microversion: 2.1 time: 0.569149 Nov 24 03:06:28.426649 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 214/406] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:27 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1358 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:28.435825 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4b0fd3b6-a0af-4f73-9dbe-8f1815089591 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:28.437031 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4b0fd3b6-a0af-4f73-9dbe-8f1815089591 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:28.447981 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4b0fd3b6-a0af-4f73-9dbe-8f1815089591 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:28.448686 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4b0fd3b6-a0af-4f73-9dbe-8f1815089591 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:28.450302 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4b0fd3b6-a0af-4f73-9dbe-8f1815089591 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:28.451125 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4b0fd3b6-a0af-4f73-9dbe-8f1815089591 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:28.791360 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4b0fd3b6-a0af-4f73-9dbe-8f1815089591 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:28.801604 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4b0fd3b6-a0af-4f73-9dbe-8f1815089591 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1509 microversion: 2.1 time: 0.373332 Nov 24 03:06:28.802787 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 215/407] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:28 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1509 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:28.886829 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-017592cd-fc94-46de-abb5-57c6901edd2c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:28.887615 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-017592cd-fc94-46de-abb5-57c6901edd2c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:28.894222 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-017592cd-fc94-46de-abb5-57c6901edd2c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:28.894722 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-017592cd-fc94-46de-abb5-57c6901edd2c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:28.895474 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-017592cd-fc94-46de-abb5-57c6901edd2c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:28.895899 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-017592cd-fc94-46de-abb5-57c6901edd2c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:29.061582 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-017592cd-fc94-46de-abb5-57c6901edd2c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:29.070950 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-017592cd-fc94-46de-abb5-57c6901edd2c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:29.073049 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-017592cd-fc94-46de-abb5-57c6901edd2c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:29.074516 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-017592cd-fc94-46de-abb5-57c6901edd2c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1745 microversion: 2.20 time: 0.191499 Nov 24 03:06:29.075298 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 216/408] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:28 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1745 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:29.445221 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-6c278418-7f47-4893-a7a9-2c32bef2b523 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:29.445941 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-6c278418-7f47-4893-a7a9-2c32bef2b523 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:29.453118 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6c278418-7f47-4893-a7a9-2c32bef2b523 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:29.454288 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6c278418-7f47-4893-a7a9-2c32bef2b523 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:29.455442 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6c278418-7f47-4893-a7a9-2c32bef2b523 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:29.456222 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6c278418-7f47-4893-a7a9-2c32bef2b523 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:29.722532 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-6c278418-7f47-4893-a7a9-2c32bef2b523 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:29.769387 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-abfb338e-1c94-479d-9044-2d9a92d1a807 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 28625 microversion: 2.1 time: 2.441589 Nov 24 03:06:29.770675 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 193/409] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:27 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 28625 bytes in 2446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:06:29.801322 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-6c278418-7f47-4893-a7a9-2c32bef2b523 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1358 microversion: 2.1 time: 0.360810 Nov 24 03:06:29.812145 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 217/410] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:29 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1358 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:29.821792 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f8483cb4-a761-4721-9ae3-c8eba5b4fa21 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:29.822823 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f8483cb4-a761-4721-9ae3-c8eba5b4fa21 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:29.842824 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f8483cb4-a761-4721-9ae3-c8eba5b4fa21 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:29.843751 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f8483cb4-a761-4721-9ae3-c8eba5b4fa21 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:29.845129 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f8483cb4-a761-4721-9ae3-c8eba5b4fa21 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:29.845904 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f8483cb4-a761-4721-9ae3-c8eba5b4fa21 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:30.099231 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2ec21a5e-53ad-4d81-aa25-e8569ba55019 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:30.105526 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2ec21a5e-53ad-4d81-aa25-e8569ba55019 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:30.123697 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ec21a5e-53ad-4d81-aa25-e8569ba55019 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:30.124561 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ec21a5e-53ad-4d81-aa25-e8569ba55019 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:30.125896 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ec21a5e-53ad-4d81-aa25-e8569ba55019 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:30.126851 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ec21a5e-53ad-4d81-aa25-e8569ba55019 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:30.232581 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f8483cb4-a761-4721-9ae3-c8eba5b4fa21 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:30.245419 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f8483cb4-a761-4721-9ae3-c8eba5b4fa21 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1509 microversion: 2.1 time: 0.429047 Nov 24 03:06:30.246769 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 194/411] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:29 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1509 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:30.486671 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2ec21a5e-53ad-4d81-aa25-e8569ba55019 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:30.513093 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2ec21a5e-53ad-4d81-aa25-e8569ba55019 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:30.519999 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2ec21a5e-53ad-4d81-aa25-e8569ba55019 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:30.523858 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2ec21a5e-53ad-4d81-aa25-e8569ba55019 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1740 microversion: 2.20 time: 0.429142 Nov 24 03:06:30.525180 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 218/412] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:30 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1740 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:30.785696 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-95e04639-0ae6-4ae7-8b10-40766c368048 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:30.787573 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-95e04639-0ae6-4ae7-8b10-40766c368048 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:30.796138 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-95e04639-0ae6-4ae7-8b10-40766c368048 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:30.796609 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-95e04639-0ae6-4ae7-8b10-40766c368048 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:30.797513 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-95e04639-0ae6-4ae7-8b10-40766c368048 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:30.798005 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-95e04639-0ae6-4ae7-8b10-40766c368048 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:30.826091 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2a165de2-910c-404d-932a-e825252b95f0 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:30.827683 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2a165de2-910c-404d-932a-e825252b95f0 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:30.842729 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2a165de2-910c-404d-932a-e825252b95f0 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:30.844416 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2a165de2-910c-404d-932a-e825252b95f0 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:30.845632 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2a165de2-910c-404d-932a-e825252b95f0 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:30.848097 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2a165de2-910c-404d-932a-e825252b95f0 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:30.933973 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-95e04639-0ae6-4ae7-8b10-40766c368048 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 28625 microversion: 2.1 time: 0.155086 Nov 24 03:06:30.934668 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 195/413] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:30 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 28625 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 03:06:31.177578 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2a165de2-910c-404d-932a-e825252b95f0 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:31.202704 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2a165de2-910c-404d-932a-e825252b95f0 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1358 microversion: 2.1 time: 0.382025 Nov 24 03:06:31.238132 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 219/414] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:30 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1358 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:31.266259 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-84248a67-c096-4c6a-ad02-62d933ea6584 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:31.266888 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-84248a67-c096-4c6a-ad02-62d933ea6584 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:31.288666 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-84248a67-c096-4c6a-ad02-62d933ea6584 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:31.289107 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-84248a67-c096-4c6a-ad02-62d933ea6584 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:31.290148 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-84248a67-c096-4c6a-ad02-62d933ea6584 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:31.290736 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-84248a67-c096-4c6a-ad02-62d933ea6584 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:31.544397 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-d0efcc0a-30cb-4870-82a5-d65966e1d25a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:31.545293 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-d0efcc0a-30cb-4870-82a5-d65966e1d25a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:31.557661 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d0efcc0a-30cb-4870-82a5-d65966e1d25a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:31.568416 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d0efcc0a-30cb-4870-82a5-d65966e1d25a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:31.569567 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d0efcc0a-30cb-4870-82a5-d65966e1d25a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:31.570211 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d0efcc0a-30cb-4870-82a5-d65966e1d25a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:31.667206 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-84248a67-c096-4c6a-ad02-62d933ea6584 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:31.679018 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-84248a67-c096-4c6a-ad02-62d933ea6584 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1515 microversion: 2.1 time: 0.417731 Nov 24 03:06:31.703718 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 196/415] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:31 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1515 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:31.823880 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-d0efcc0a-30cb-4870-82a5-d65966e1d25a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:31.844291 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-d0efcc0a-30cb-4870-82a5-d65966e1d25a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:31.849565 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-d0efcc0a-30cb-4870-82a5-d65966e1d25a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:31.852998 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-d0efcc0a-30cb-4870-82a5-d65966e1d25a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1740 microversion: 2.20 time: 0.311795 Nov 24 03:06:31.865561 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 220/416] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:31 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1740 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:06:31.956160 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-02a011b4-d926-4cf4-97e7-2c0b845cec06 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:31.957256 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-02a011b4-d926-4cf4-97e7-2c0b845cec06 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:31.979635 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-02a011b4-d926-4cf4-97e7-2c0b845cec06 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:31.982250 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-02a011b4-d926-4cf4-97e7-2c0b845cec06 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:31.983324 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-02a011b4-d926-4cf4-97e7-2c0b845cec06 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:31.983783 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-02a011b4-d926-4cf4-97e7-2c0b845cec06 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:32.152521 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-02a011b4-d926-4cf4-97e7-2c0b845cec06 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 28625 microversion: 2.1 time: 0.208131 Nov 24 03:06:32.153403 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 197/417] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:31 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 28625 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:06:32.245380 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-fe57fed4-9b4c-4c66-8977-a53e443fd8ad tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:32.246435 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-fe57fed4-9b4c-4c66-8977-a53e443fd8ad tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:32.258462 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fe57fed4-9b4c-4c66-8977-a53e443fd8ad tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:32.259347 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fe57fed4-9b4c-4c66-8977-a53e443fd8ad tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:32.262088 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fe57fed4-9b4c-4c66-8977-a53e443fd8ad tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:32.262916 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fe57fed4-9b4c-4c66-8977-a53e443fd8ad tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:32.622934 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a6ee598a-9931-49e9-8216-cfb4d63a8da1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:32.628383 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a6ee598a-9931-49e9-8216-cfb4d63a8da1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:32.647026 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a6ee598a-9931-49e9-8216-cfb4d63a8da1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:32.647808 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a6ee598a-9931-49e9-8216-cfb4d63a8da1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:32.649758 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a6ee598a-9931-49e9-8216-cfb4d63a8da1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:32.651877 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a6ee598a-9931-49e9-8216-cfb4d63a8da1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:32.751343 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-fe57fed4-9b4c-4c66-8977-a53e443fd8ad tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:32.759921 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-fe57fed4-9b4c-4c66-8977-a53e443fd8ad tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1358 microversion: 2.1 time: 0.520713 Nov 24 03:06:32.766501 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 221/418] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:32 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1358 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:32.875569 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-6bc02e0f-1878-4519-a599-85c162644157 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:32.878167 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-6bc02e0f-1878-4519-a599-85c162644157 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:32.900125 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6bc02e0f-1878-4519-a599-85c162644157 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:32.900729 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6bc02e0f-1878-4519-a599-85c162644157 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:32.903695 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6bc02e0f-1878-4519-a599-85c162644157 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:32.907272 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6bc02e0f-1878-4519-a599-85c162644157 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:32.963291 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-a6ee598a-9931-49e9-8216-cfb4d63a8da1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lazy-loading 'services' on Instance uuid ab488065-b4b5-481a-9a30-89acf3255d28 {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:06:33.075590 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a6ee598a-9931-49e9-8216-cfb4d63a8da1 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28/os-volume_attachments/360b6e07-26cb-47b5-a7f3-de18c8671caf" status: 202 len: 0 microversion: 2.1 time: 0.459372 Nov 24 03:06:33.083245 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 198/419] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Nov 24 03:06:32 2021] DELETE /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28/os-volume_attachments/360b6e07-26cb-47b5-a7f3-de18c8671caf => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:06:33.096856 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-dc07964c-045d-4835-8429-077cdb2e82c9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:33.109014 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-dc07964c-045d-4835-8429-077cdb2e82c9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:33.131060 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dc07964c-045d-4835-8429-077cdb2e82c9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:33.131479 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dc07964c-045d-4835-8429-077cdb2e82c9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:33.136038 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dc07964c-045d-4835-8429-077cdb2e82c9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:33.137657 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dc07964c-045d-4835-8429-077cdb2e82c9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:33.201932 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-dc07964c-045d-4835-8429-077cdb2e82c9 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114243 Nov 24 03:06:33.203526 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 199/420] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Nov 24 03:06:33 2021] GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:06:33.208477 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b4038c3c-d611-4966-b1a6-8b665f6bf13d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:33.209673 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b4038c3c-d611-4966-b1a6-8b665f6bf13d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:33.217061 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b4038c3c-d611-4966-b1a6-8b665f6bf13d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:33.217762 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b4038c3c-d611-4966-b1a6-8b665f6bf13d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:33.218951 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b4038c3c-d611-4966-b1a6-8b665f6bf13d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:33.219585 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b4038c3c-d611-4966-b1a6-8b665f6bf13d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:33.399499 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b4038c3c-d611-4966-b1a6-8b665f6bf13d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 28657 microversion: 2.1 time: 0.194502 Nov 24 03:06:33.404002 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 200/421] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:33 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 28657 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:06:33.540106 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-6bc02e0f-1878-4519-a599-85c162644157 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:33.553979 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-6bc02e0f-1878-4519-a599-85c162644157 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:33.569598 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-6bc02e0f-1878-4519-a599-85c162644157 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:33.582108 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-6bc02e0f-1878-4519-a599-85c162644157 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1740 microversion: 2.20 time: 0.711724 Nov 24 03:06:33.582993 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 222/422] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:32 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1740 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:06:33.711776 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5b0a20fb-0a69-4d74-8ee0-0e4cb52b4c01 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:33.712038 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5b0a20fb-0a69-4d74-8ee0-0e4cb52b4c01 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:33.766499 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5b0a20fb-0a69-4d74-8ee0-0e4cb52b4c01 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:33.782091 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5b0a20fb-0a69-4d74-8ee0-0e4cb52b4c01 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:33.789177 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5b0a20fb-0a69-4d74-8ee0-0e4cb52b4c01 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:33.789177 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5b0a20fb-0a69-4d74-8ee0-0e4cb52b4c01 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:33.789437 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-eaf3f747-e864-4c2e-bcb9-671becb44d42 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:33.789437 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-eaf3f747-e864-4c2e-bcb9-671becb44d42 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:33.802700 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-eaf3f747-e864-4c2e-bcb9-671becb44d42 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:33.814623 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-eaf3f747-e864-4c2e-bcb9-671becb44d42 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:33.815884 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-eaf3f747-e864-4c2e-bcb9-671becb44d42 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:33.816477 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-eaf3f747-e864-4c2e-bcb9-671becb44d42 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:34.295098 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-eaf3f747-e864-4c2e-bcb9-671becb44d42 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:34.309468 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-eaf3f747-e864-4c2e-bcb9-671becb44d42 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1358 microversion: 2.1 time: 0.528111 Nov 24 03:06:34.320437 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 223/423] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:33 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1358 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:34.341004 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-03798b92-a0b0-4534-91c1-85e8302e590f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:34.342598 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-03798b92-a0b0-4534-91c1-85e8302e590f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:34.368143 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-03798b92-a0b0-4534-91c1-85e8302e590f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:34.368951 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-03798b92-a0b0-4534-91c1-85e8302e590f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:34.370432 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-03798b92-a0b0-4534-91c1-85e8302e590f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:34.371038 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-03798b92-a0b0-4534-91c1-85e8302e590f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:34.463347 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-03798b92-a0b0-4534-91c1-85e8302e590f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.141155 Nov 24 03:06:34.464255 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 224/424] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Nov 24 03:06:34 2021] GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:06:34.487511 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-68c0efd4-dcdb-4a3a-a2a2-d4ff7dad7258 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:34.488540 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-68c0efd4-dcdb-4a3a-a2a2-d4ff7dad7258 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:34.509810 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-68c0efd4-dcdb-4a3a-a2a2-d4ff7dad7258 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:34.510474 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-68c0efd4-dcdb-4a3a-a2a2-d4ff7dad7258 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:34.511499 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-68c0efd4-dcdb-4a3a-a2a2-d4ff7dad7258 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:34.511950 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-68c0efd4-dcdb-4a3a-a2a2-d4ff7dad7258 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:34.676614 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-68c0efd4-dcdb-4a3a-a2a2-d4ff7dad7258 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 30138 microversion: 2.1 time: 0.199440 Nov 24 03:06:34.680107 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 225/425] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:34 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 30138 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:06:34.701847 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5e411de2-29d6-4a1c-9759-84102653f591 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:34.708295 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-5e411de2-29d6-4a1c-9759-84102653f591 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:34.743435 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5e411de2-29d6-4a1c-9759-84102653f591 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:34.746174 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5e411de2-29d6-4a1c-9759-84102653f591 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:34.748561 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5e411de2-29d6-4a1c-9759-84102653f591 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:34.751124 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5e411de2-29d6-4a1c-9759-84102653f591 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:34.896667 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5b0a20fb-0a69-4d74-8ee0-0e4cb52b4c01 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:34.917378 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5b0a20fb-0a69-4d74-8ee0-0e4cb52b4c01 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1515 microversion: 2.1 time: 1.199755 Nov 24 03:06:34.923428 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 201/426] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:33 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1515 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:34.950036 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-57bbd174-1184-4817-ab45-6098b2027703 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8bb8cfa-7052-4e08-87cc-6b73d40979d2"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:34.955857 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-57bbd174-1184-4817-ab45-6098b2027703 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:34.986715 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-57bbd174-1184-4817-ab45-6098b2027703 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:34.987192 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-57bbd174-1184-4817-ab45-6098b2027703 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:34.993124 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-57bbd174-1184-4817-ab45-6098b2027703 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:35.002929 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-57bbd174-1184-4817-ab45-6098b2027703 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:35.475893 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5e411de2-29d6-4a1c-9759-84102653f591 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:35.488300 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5e411de2-29d6-4a1c-9759-84102653f591 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:35.489853 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5e411de2-29d6-4a1c-9759-84102653f591 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:35.503858 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-5e411de2-29d6-4a1c-9759-84102653f591 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1740 microversion: 2.20 time: 0.821790 Nov 24 03:06:35.510344 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 226/427] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:34 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1740 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:35.543408 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-71d4fcab-f5a8-49b3-a3c8-97d3c3e77bce tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:35.551474 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-71d4fcab-f5a8-49b3-a3c8-97d3c3e77bce tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:35.597513 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-71d4fcab-f5a8-49b3-a3c8-97d3c3e77bce tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:35.597758 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-71d4fcab-f5a8-49b3-a3c8-97d3c3e77bce tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:35.602351 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-71d4fcab-f5a8-49b3-a3c8-97d3c3e77bce tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:35.609792 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-71d4fcab-f5a8-49b3-a3c8-97d3c3e77bce tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:35.861756 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-57bbd174-1184-4817-ab45-6098b2027703 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "POST /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.928039 Nov 24 03:06:35.877284 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 202/428] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Nov 24 03:06:34 2021] POST /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/os-volume_attachments => generated 194 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:06:35.900689 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e3a42c32-52d6-4742-b15c-440a77676abc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:35.904243 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e3a42c32-52d6-4742-b15c-440a77676abc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:35.926278 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e3a42c32-52d6-4742-b15c-440a77676abc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:35.928212 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e3a42c32-52d6-4742-b15c-440a77676abc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:35.929812 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e3a42c32-52d6-4742-b15c-440a77676abc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:35.950968 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e3a42c32-52d6-4742-b15c-440a77676abc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:36.172180 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e3a42c32-52d6-4742-b15c-440a77676abc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 31906 microversion: 2.1 time: 0.292778 Nov 24 03:06:36.176255 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 203/429] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:35 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 31906 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:06:36.180781 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f2397cfb-cb46-49e3-9736-703e8a9ecec4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:36.181379 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f2397cfb-cb46-49e3-9736-703e8a9ecec4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:36.207667 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f2397cfb-cb46-49e3-9736-703e8a9ecec4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:36.208136 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f2397cfb-cb46-49e3-9736-703e8a9ecec4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:36.210210 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f2397cfb-cb46-49e3-9736-703e8a9ecec4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:36.210655 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f2397cfb-cb46-49e3-9736-703e8a9ecec4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:36.272331 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f2397cfb-cb46-49e3-9736-703e8a9ecec4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:06:36.438614 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f2397cfb-cb46-49e3-9736-703e8a9ecec4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28" status: 204 len: 0 microversion: 2.1 time: 0.263401 Nov 24 03:06:36.441409 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 204/430] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:06:36 2021] DELETE /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:06:36.461259 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fa74886d-925d-43da-9553-b604045093ce tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:36.465625 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fa74886d-925d-43da-9553-b604045093ce tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:36.484138 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fa74886d-925d-43da-9553-b604045093ce tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:36.484602 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fa74886d-925d-43da-9553-b604045093ce tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:36.494880 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fa74886d-925d-43da-9553-b604045093ce tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:36.495600 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fa74886d-925d-43da-9553-b604045093ce tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:36.546166 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-71d4fcab-f5a8-49b3-a3c8-97d3c3e77bce tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:36.563317 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-71d4fcab-f5a8-49b3-a3c8-97d3c3e77bce tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1358 microversion: 2.1 time: 1.051766 Nov 24 03:06:36.577794 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 227/431] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:35 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1358 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:36.600878 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-8447b3b3-c232-41f0-ae8b-51e83acf7364 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:36.607594 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-8447b3b3-c232-41f0-ae8b-51e83acf7364 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:36.644285 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8447b3b3-c232-41f0-ae8b-51e83acf7364 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:36.645320 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8447b3b3-c232-41f0-ae8b-51e83acf7364 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:36.648999 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8447b3b3-c232-41f0-ae8b-51e83acf7364 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:36.650358 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8447b3b3-c232-41f0-ae8b-51e83acf7364 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:37.040693 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-fa74886d-925d-43da-9553-b604045093ce tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:37.051979 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fa74886d-925d-43da-9553-b604045093ce tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28" status: 200 len: 1513 microversion: 2.1 time: 0.605284 Nov 24 03:06:37.053592 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 205/432] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:36 2021] GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28 => generated 1513 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:06:37.184636 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c2a59195-549f-4890-a1c2-b8adcc157f8e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:37.185573 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c2a59195-549f-4890-a1c2-b8adcc157f8e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:37.198762 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2a59195-549f-4890-a1c2-b8adcc157f8e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:37.199244 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2a59195-549f-4890-a1c2-b8adcc157f8e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:37.200110 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2a59195-549f-4890-a1c2-b8adcc157f8e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:37.202298 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2a59195-549f-4890-a1c2-b8adcc157f8e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:37.275621 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-8447b3b3-c232-41f0-ae8b-51e83acf7364 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:37.285735 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-8447b3b3-c232-41f0-ae8b-51e83acf7364 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:37.301592 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-8447b3b3-c232-41f0-ae8b-51e83acf7364 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:37.303584 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-8447b3b3-c232-41f0-ae8b-51e83acf7364 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1740 microversion: 2.20 time: 0.724133 Nov 24 03:06:37.319230 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 228/433] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:36 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1740 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:37.356629 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c2a59195-549f-4890-a1c2-b8adcc157f8e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 32854 microversion: 2.1 time: 0.175939 Nov 24 03:06:37.360719 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 206/434] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:37 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 32854 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 03:06:37.396535 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-5a3510fb-b2dc-499a-af30-d7e3793342f3 req-a625c2ac-cd5f-416c-ac84-59d391d010d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7751b5e-4ff9-4a10-be90-35dc8498899c", "name": "network-vif-plugged", "status": "completed", "tag": "2ece000a-104a-46f1-8ab6-c4772032c9cf"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:37.398481 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:06:37.398481 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:06:37.412533 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-5a3510fb-b2dc-499a-af30-d7e3793342f3 req-a625c2ac-cd5f-416c-ac84-59d391d010d1 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:37.414532 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-5a3510fb-b2dc-499a-af30-d7e3793342f3 req-a625c2ac-cd5f-416c-ac84-59d391d010d1 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:37.442947 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-5a3510fb-b2dc-499a-af30-d7e3793342f3 req-a625c2ac-cd5f-416c-ac84-59d391d010d1 service nova] Creating event network-vif-plugged:2ece000a-104a-46f1-8ab6-c4772032c9cf for instance d7751b5e-4ff9-4a10-be90-35dc8498899c on hv-cinder-81803 Nov 24 03:06:37.455055 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-5a3510fb-b2dc-499a-af30-d7e3793342f3 req-a625c2ac-cd5f-416c-ac84-59d391d010d1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062747 Nov 24 03:06:37.455678 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 229/435] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:06:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:06:37.583365 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f3c796bd-1883-47a0-93c2-a45276ca7c30 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:37.584075 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f3c796bd-1883-47a0-93c2-a45276ca7c30 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:37.602034 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f3c796bd-1883-47a0-93c2-a45276ca7c30 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:37.613172 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f3c796bd-1883-47a0-93c2-a45276ca7c30 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:37.614252 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f3c796bd-1883-47a0-93c2-a45276ca7c30 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:37.614714 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f3c796bd-1883-47a0-93c2-a45276ca7c30 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:38.022153 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f3c796bd-1883-47a0-93c2-a45276ca7c30 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:38.030549 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f3c796bd-1883-47a0-93c2-a45276ca7c30 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1358 microversion: 2.1 time: 0.451724 Nov 24 03:06:38.038752 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 207/436] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:37 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1358 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:38.079619 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-fb076dcb-1f8e-4128-a588-30c69f2fe715 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:38.084446 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-fb076dcb-1f8e-4128-a588-30c69f2fe715 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:38.093089 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fb076dcb-1f8e-4128-a588-30c69f2fe715 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:38.093965 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fb076dcb-1f8e-4128-a588-30c69f2fe715 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:38.095052 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fb076dcb-1f8e-4128-a588-30c69f2fe715 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:38.095722 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fb076dcb-1f8e-4128-a588-30c69f2fe715 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:38.327253 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-15aaaaec-edc2-409b-83b5-3f9ad9089206 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:38.328044 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-15aaaaec-edc2-409b-83b5-3f9ad9089206 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:38.346076 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15aaaaec-edc2-409b-83b5-3f9ad9089206 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:38.346824 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15aaaaec-edc2-409b-83b5-3f9ad9089206 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:38.348819 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15aaaaec-edc2-409b-83b5-3f9ad9089206 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:38.350535 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15aaaaec-edc2-409b-83b5-3f9ad9089206 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:38.754045 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-15aaaaec-edc2-409b-83b5-3f9ad9089206 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:38.767233 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-15aaaaec-edc2-409b-83b5-3f9ad9089206 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:38.769613 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-15aaaaec-edc2-409b-83b5-3f9ad9089206 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:38.783945 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-15aaaaec-edc2-409b-83b5-3f9ad9089206 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1740 microversion: 2.20 time: 0.461077 Nov 24 03:06:38.794793 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 208/437] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:38 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1740 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:38.800727 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-dddaf9b2-09b0-4642-9894-cec695bc0551 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:38.802043 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-dddaf9b2-09b0-4642-9894-cec695bc0551 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:38.820346 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dddaf9b2-09b0-4642-9894-cec695bc0551 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:38.820799 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dddaf9b2-09b0-4642-9894-cec695bc0551 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:38.821603 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dddaf9b2-09b0-4642-9894-cec695bc0551 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:38.822063 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dddaf9b2-09b0-4642-9894-cec695bc0551 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:38.961799 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-dddaf9b2-09b0-4642-9894-cec695bc0551 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 33729 microversion: 2.1 time: 0.165394 Nov 24 03:06:38.963283 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 209/438] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:38 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 33729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:06:39.059556 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6c012a86-fb45-4671-91ac-57ee8859bcdd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:39.060573 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6c012a86-fb45-4671-91ac-57ee8859bcdd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:39.083825 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c012a86-fb45-4671-91ac-57ee8859bcdd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:39.084562 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c012a86-fb45-4671-91ac-57ee8859bcdd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:39.085538 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c012a86-fb45-4671-91ac-57ee8859bcdd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:39.090683 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c012a86-fb45-4671-91ac-57ee8859bcdd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:39.508355 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-fb076dcb-1f8e-4128-a588-30c69f2fe715 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:39.527541 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-fb076dcb-1f8e-4128-a588-30c69f2fe715 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28" status: 200 len: 1513 microversion: 2.1 time: 1.456331 Nov 24 03:06:39.528878 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 230/439] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:38 2021] GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28 => generated 1513 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:39.740580 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6c012a86-fb45-4671-91ac-57ee8859bcdd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:39.763495 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6c012a86-fb45-4671-91ac-57ee8859bcdd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1358 microversion: 2.1 time: 0.711696 Nov 24 03:06:39.782759 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 210/440] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:39 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1358 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:39.816548 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-9be30357-4cdb-4371-9899-6389e4da53b9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:39.817045 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-9be30357-4cdb-4371-9899-6389e4da53b9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:39.855979 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9be30357-4cdb-4371-9899-6389e4da53b9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:39.874556 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9be30357-4cdb-4371-9899-6389e4da53b9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:39.875855 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9be30357-4cdb-4371-9899-6389e4da53b9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:39.876332 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9be30357-4cdb-4371-9899-6389e4da53b9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:39.976253 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-926248ac-8b0c-4b67-8431-94429ea04191 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:39.977249 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-926248ac-8b0c-4b67-8431-94429ea04191 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:40.003843 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-926248ac-8b0c-4b67-8431-94429ea04191 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:40.004551 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-926248ac-8b0c-4b67-8431-94429ea04191 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:40.014035 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-926248ac-8b0c-4b67-8431-94429ea04191 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:40.014518 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-926248ac-8b0c-4b67-8431-94429ea04191 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:40.188132 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-926248ac-8b0c-4b67-8431-94429ea04191 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 34900 microversion: 2.1 time: 0.216329 Nov 24 03:06:40.189095 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 211/441] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:39 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 34900 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:06:40.255585 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-06231fc8-374b-4a61-9227-2bbdab42e80a req-ed9bdcce-8bf3-4aea-9423-4f96483d7922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab488065-b4b5-481a-9a30-89acf3255d28", "name": "network-vif-deleted", "tag": "c1b8a16d-4144-49ef-8026-f0477b55378f"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:40.271508 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:06:40.271508 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:06:40.298350 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-06231fc8-374b-4a61-9227-2bbdab42e80a req-ed9bdcce-8bf3-4aea-9423-4f96483d7922 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:40.303786 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-06231fc8-374b-4a61-9227-2bbdab42e80a req-ed9bdcce-8bf3-4aea-9423-4f96483d7922 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:40.333749 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-06231fc8-374b-4a61-9227-2bbdab42e80a req-ed9bdcce-8bf3-4aea-9423-4f96483d7922 service nova] Creating event network-vif-deleted:c1b8a16d-4144-49ef-8026-f0477b55378f for instance ab488065-b4b5-481a-9a30-89acf3255d28 on hv-cinder-81803 Nov 24 03:06:40.339819 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-06231fc8-374b-4a61-9227-2bbdab42e80a req-ed9bdcce-8bf3-4aea-9423-4f96483d7922 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115271 Nov 24 03:06:40.341504 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 212/442] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:06:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:06:40.546217 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4acfabd3-93aa-4ee5-bb15-b603708df734 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:40.561162 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4acfabd3-93aa-4ee5-bb15-b603708df734 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:40.605887 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4acfabd3-93aa-4ee5-bb15-b603708df734 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:40.606694 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4acfabd3-93aa-4ee5-bb15-b603708df734 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:40.607574 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4acfabd3-93aa-4ee5-bb15-b603708df734 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:40.629517 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4acfabd3-93aa-4ee5-bb15-b603708df734 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:40.815294 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4acfabd3-93aa-4ee5-bb15-b603708df734 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:40.815853 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4acfabd3-93aa-4ee5-bb15-b603708df734 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:40.822856 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-4acfabd3-93aa-4ee5-bb15-b603708df734 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lazy-loading 'fault' on Instance uuid ab488065-b4b5-481a-9a30-89acf3255d28 {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:06:40.949481 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4acfabd3-93aa-4ee5-bb15-b603708df734 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:40.965142 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4acfabd3-93aa-4ee5-bb15-b603708df734 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28" status: 200 len: 1307 microversion: 2.1 time: 0.422550 Nov 24 03:06:40.980149 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 213/443] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:40 2021] GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28 => generated 1307 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:06:40.996583 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4235b89b-66bf-4b1d-a986-69de1e7bae31 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:41.000627 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4235b89b-66bf-4b1d-a986-69de1e7bae31 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:41.028422 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4235b89b-66bf-4b1d-a986-69de1e7bae31 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:41.029272 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4235b89b-66bf-4b1d-a986-69de1e7bae31 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:41.033464 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4235b89b-66bf-4b1d-a986-69de1e7bae31 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:41.054981 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4235b89b-66bf-4b1d-a986-69de1e7bae31 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:41.081632 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-9be30357-4cdb-4371-9899-6389e4da53b9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:41.094832 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-9be30357-4cdb-4371-9899-6389e4da53b9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:41.096795 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-9be30357-4cdb-4371-9899-6389e4da53b9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:41.119473 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-9be30357-4cdb-4371-9899-6389e4da53b9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1740 microversion: 2.20 time: 1.317086 Nov 24 03:06:41.122627 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 231/444] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:39 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1740 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:41.201752 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-1ba93da7-ff98-46df-a3ad-d0e0409deedd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:41.202946 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-1ba93da7-ff98-46df-a3ad-d0e0409deedd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:41.236507 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1ba93da7-ff98-46df-a3ad-d0e0409deedd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:41.236959 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1ba93da7-ff98-46df-a3ad-d0e0409deedd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:41.237811 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1ba93da7-ff98-46df-a3ad-d0e0409deedd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:41.238313 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1ba93da7-ff98-46df-a3ad-d0e0409deedd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:41.396225 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-1ba93da7-ff98-46df-a3ad-d0e0409deedd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 35754 microversion: 2.1 time: 0.199662 Nov 24 03:06:41.396877 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 232/445] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:41 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 35754 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 03:06:41.405649 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4235b89b-66bf-4b1d-a986-69de1e7bae31 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:41.414536 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4235b89b-66bf-4b1d-a986-69de1e7bae31 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1548 microversion: 2.1 time: 0.432814 Nov 24 03:06:41.415458 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 214/446] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:40 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1548 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:41.435759 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-eaaed1cb-5fb6-409b-999c-30e9c6be2566 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:41.436365 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-eaaed1cb-5fb6-409b-999c-30e9c6be2566 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:41.458447 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-eaaed1cb-5fb6-409b-999c-30e9c6be2566 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:41.462547 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-eaaed1cb-5fb6-409b-999c-30e9c6be2566 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:41.463830 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-eaaed1cb-5fb6-409b-999c-30e9c6be2566 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:41.466408 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-eaaed1cb-5fb6-409b-999c-30e9c6be2566 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:41.808493 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-eaaed1cb-5fb6-409b-999c-30e9c6be2566 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:41.826262 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-eaaed1cb-5fb6-409b-999c-30e9c6be2566 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1548 microversion: 2.1 time: 0.395089 Nov 24 03:06:41.841712 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 233/447] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:41 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1548 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:41.852756 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e8d181ee-3900-49ee-8229-338b443a7144 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:41.864005 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:06:41.864005 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:06:41.876705 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e8d181ee-3900-49ee-8229-338b443a7144 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:41.877592 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e8d181ee-3900-49ee-8229-338b443a7144 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Searching by: {'deleted': False, 'project_id': '9bd704828d96416e8c51b5330f2e067e'} {{(pid=116331) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 24 03:06:41.904242 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e8d181ee-3900-49ee-8229-338b443a7144 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:41.905024 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e8d181ee-3900-49ee-8229-338b443a7144 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:41.906209 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e8d181ee-3900-49ee-8229-338b443a7144 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:41.906654 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e8d181ee-3900-49ee-8229-338b443a7144 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:42.141105 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.multi_cell_list [None req-e8d181ee-3900-49ee-8229-338b443a7144 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116331) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 24 03:06:42.162667 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a7dd9432-b39b-402a-816c-41927978f09f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Action: 'create', calling method: .version_select at 0x7f7a2e8e3f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1838051711"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:42.210298 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-a7dd9432-b39b-402a-816c-41927978f09f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Getting quotas for project 1e5a7594dcfc4cc6b0e9d09a768fd72f. Resources: {'key_pairs'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:06:42.214378 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-a7dd9432-b39b-402a-816c-41927978f09f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Getting quotas for user 848fe17e3a994374a7a30d38ed5e3299 and project 1e5a7594dcfc4cc6b0e9d09a768fd72f. Resources: {'key_pairs'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:06:42.413137 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e8d181ee-3900-49ee-8229-338b443a7144 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.569883 Nov 24 03:06:42.414717 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 234/448] 10.222.0.52 () {58 vars in 1124 bytes} [Wed Nov 24 03:06:41 2021] GET /compute/v2.1/servers => generated 342 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:06:42.461204 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-cffce699-d0ed-4454-8b0b-570767f16110 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:42.461905 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-cffce699-d0ed-4454-8b0b-570767f16110 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ab488065-b4b5-481a-9a30-89acf3255d28] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:42.468750 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cffce699-d0ed-4454-8b0b-570767f16110 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:42.469209 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cffce699-d0ed-4454-8b0b-570767f16110 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:42.481782 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cffce699-d0ed-4454-8b0b-570767f16110 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:42.482401 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cffce699-d0ed-4454-8b0b-570767f16110 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:42.520139 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-cffce699-d0ed-4454-8b0b-570767f16110 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] HTTP exception thrown: Instance ab488065-b4b5-481a-9a30-89acf3255d28 could not be found. Nov 24 03:06:42.522225 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-cffce699-d0ed-4454-8b0b-570767f16110 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Returning 404 to user: Instance ab488065-b4b5-481a-9a30-89acf3255d28 could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:06:42.523243 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-cffce699-d0ed-4454-8b0b-570767f16110 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28" status: 404 len: 111 microversion: 2.1 time: 0.107475 Nov 24 03:06:42.526369 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-a7dd9432-b39b-402a-816c-41927978f09f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Getting quotas for project 1e5a7594dcfc4cc6b0e9d09a768fd72f. Resources: {'key_pairs'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:06:42.529744 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 235/449] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:42 2021] GET /compute/v2.1/servers/ab488065-b4b5-481a-9a30-89acf3255d28 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:06:42.534893 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-08a40362-0533-4937-9a32-e68ed9036fc9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:42.536619 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-08a40362-0533-4937-9a32-e68ed9036fc9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:42.541246 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-a7dd9432-b39b-402a-816c-41927978f09f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Getting quotas for user 848fe17e3a994374a7a30d38ed5e3299 and project 1e5a7594dcfc4cc6b0e9d09a768fd72f. Resources: {'key_pairs'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:06:42.554346 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-08a40362-0533-4937-9a32-e68ed9036fc9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:42.554810 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-08a40362-0533-4937-9a32-e68ed9036fc9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:42.555604 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-08a40362-0533-4937-9a32-e68ed9036fc9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:42.556436 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-08a40362-0533-4937-9a32-e68ed9036fc9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:42.569143 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a7dd9432-b39b-402a-816c-41927978f09f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.846330 Nov 24 03:06:42.575145 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 215/450] 10.222.0.52 () {60 vars in 1157 bytes} [Wed Nov 24 03:06:41 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:42.585270 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-44277106-3b03-46f4-b173-ac41182eeb35 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:42.586613 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-44277106-3b03-46f4-b173-ac41182eeb35 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:42.605357 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-44277106-3b03-46f4-b173-ac41182eeb35 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:42.606300 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-44277106-3b03-46f4-b173-ac41182eeb35 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:42.607573 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-44277106-3b03-46f4-b173-ac41182eeb35 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:42.608130 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-44277106-3b03-46f4-b173-ac41182eeb35 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:42.763866 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-44277106-3b03-46f4-b173-ac41182eeb35 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 36904 microversion: 2.1 time: 0.185666 Nov 24 03:06:42.767253 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 216/451] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:42 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 36904 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:06:42.782303 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-18bdcc14-1ca2-4d8f-916d-ec298ebdfdcd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:42.783338 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-18bdcc14-1ca2-4d8f-916d-ec298ebdfdcd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:42.811467 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-18bdcc14-1ca2-4d8f-916d-ec298ebdfdcd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:42.818265 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-18bdcc14-1ca2-4d8f-916d-ec298ebdfdcd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:42.820535 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-18bdcc14-1ca2-4d8f-916d-ec298ebdfdcd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:42.823067 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-18bdcc14-1ca2-4d8f-916d-ec298ebdfdcd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:43.045594 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-08a40362-0533-4937-9a32-e68ed9036fc9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:43.064028 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-08a40362-0533-4937-9a32-e68ed9036fc9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:43.067193 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-08a40362-0533-4937-9a32-e68ed9036fc9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:43.072050 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-08a40362-0533-4937-9a32-e68ed9036fc9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1740 microversion: 2.20 time: 0.540940 Nov 24 03:06:43.075069 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 236/452] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:42 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1740 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:43.295619 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-18bdcc14-1ca2-4d8f-916d-ec298ebdfdcd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:43.303968 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-18bdcc14-1ca2-4d8f-916d-ec298ebdfdcd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1548 microversion: 2.1 time: 0.532795 Nov 24 03:06:43.308703 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 217/453] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:42 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1548 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:43.782785 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b288ba26-50db-42e6-873b-9973aae262b3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:43.785324 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b288ba26-50db-42e6-873b-9973aae262b3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:43.807482 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b288ba26-50db-42e6-873b-9973aae262b3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:43.814135 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b288ba26-50db-42e6-873b-9973aae262b3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:43.822093 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b288ba26-50db-42e6-873b-9973aae262b3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:43.822955 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b288ba26-50db-42e6-873b-9973aae262b3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:44.019406 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-08265201-9838-4180-85a6-756d5c61eb22 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:44.019406 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-08265201-9838-4180-85a6-756d5c61eb22 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:44.027362 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b288ba26-50db-42e6-873b-9973aae262b3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 38149 microversion: 2.1 time: 0.249313 Nov 24 03:06:44.034791 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 237/454] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:43 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 38149 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:06:44.042653 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-08265201-9838-4180-85a6-756d5c61eb22 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:44.042653 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-08265201-9838-4180-85a6-756d5c61eb22 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:44.043428 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-08265201-9838-4180-85a6-756d5c61eb22 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:44.043877 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-08265201-9838-4180-85a6-756d5c61eb22 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:44.105202 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-cb513f05-61ab-4cba-a479-dd5ed151a489 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:44.115181 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-cb513f05-61ab-4cba-a479-dd5ed151a489 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:44.142222 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb513f05-61ab-4cba-a479-dd5ed151a489 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:44.164131 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb513f05-61ab-4cba-a479-dd5ed151a489 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:44.181053 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb513f05-61ab-4cba-a479-dd5ed151a489 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:44.182883 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb513f05-61ab-4cba-a479-dd5ed151a489 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:44.307451 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-08265201-9838-4180-85a6-756d5c61eb22 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:06:44.780879 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-cb513f05-61ab-4cba-a479-dd5ed151a489 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:44.835510 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-08265201-9838-4180-85a6-756d5c61eb22 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 204 len: 0 microversion: 2.1 time: 0.822212 Nov 24 03:06:44.843362 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-cb513f05-61ab-4cba-a479-dd5ed151a489 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:44.849513 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 218/455] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:06:44 2021] DELETE /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 0 bytes in 840 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 03:06:44.856003 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-cb513f05-61ab-4cba-a479-dd5ed151a489 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:44.858649 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-cb513f05-61ab-4cba-a479-dd5ed151a489 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1740 microversion: 2.20 time: 0.768500 Nov 24 03:06:44.868040 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 238/456] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:44 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1740 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:44.882991 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-d01a9f8c-f6ee-4f2b-a8e1-1a66d3b98659 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:44.884173 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-d01a9f8c-f6ee-4f2b-a8e1-1a66d3b98659 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:44.902222 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d01a9f8c-f6ee-4f2b-a8e1-1a66d3b98659 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:44.905519 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d01a9f8c-f6ee-4f2b-a8e1-1a66d3b98659 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:44.908176 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d01a9f8c-f6ee-4f2b-a8e1-1a66d3b98659 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:44.910584 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d01a9f8c-f6ee-4f2b-a8e1-1a66d3b98659 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:44.920056 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d315f928-278e-40b6-80fa-ac63c8eb082a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:44.927872 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d315f928-278e-40b6-80fa-ac63c8eb082a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:44.998420 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d315f928-278e-40b6-80fa-ac63c8eb082a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:44.999048 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d315f928-278e-40b6-80fa-ac63c8eb082a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:45.001844 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d315f928-278e-40b6-80fa-ac63c8eb082a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:45.002323 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d315f928-278e-40b6-80fa-ac63c8eb082a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:45.077854 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-d315f928-278e-40b6-80fa-ac63c8eb082a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lazy-loading 'flavor' on Instance uuid 6bd67a95-85a5-4669-bc7b-2d50f1716c54 {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:06:45.385904 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d315f928-278e-40b6-80fa-ac63c8eb082a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "POST /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/action" status: 200 len: 32 microversion: 2.1 time: 0.530467 Nov 24 03:06:45.386962 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 219/457] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:44 2021] POST /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/action => generated 32 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:06:45.400245 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-eafb5bcf-eef0-4d50-bcda-0bf5ec2f8cb3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:45.401343 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-eafb5bcf-eef0-4d50-bcda-0bf5ec2f8cb3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:45.422118 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eafb5bcf-eef0-4d50-bcda-0bf5ec2f8cb3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:45.422861 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eafb5bcf-eef0-4d50-bcda-0bf5ec2f8cb3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:45.423840 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eafb5bcf-eef0-4d50-bcda-0bf5ec2f8cb3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:45.432780 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eafb5bcf-eef0-4d50-bcda-0bf5ec2f8cb3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:45.441778 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-d01a9f8c-f6ee-4f2b-a8e1-1a66d3b98659 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:45.472774 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-d01a9f8c-f6ee-4f2b-a8e1-1a66d3b98659 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 200 len: 1513 microversion: 2.1 time: 0.584926 Nov 24 03:06:45.487649 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 239/458] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:44 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 1513 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:45.507114 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-77cd560d-76c6-4d1c-b013-643ca6fc386e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:45.513242 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-77cd560d-76c6-4d1c-b013-643ca6fc386e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:45.530808 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-77cd560d-76c6-4d1c-b013-643ca6fc386e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:45.531348 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-77cd560d-76c6-4d1c-b013-643ca6fc386e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:45.532395 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-77cd560d-76c6-4d1c-b013-643ca6fc386e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:45.532840 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-77cd560d-76c6-4d1c-b013-643ca6fc386e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:45.545372 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-eafb5bcf-eef0-4d50-bcda-0bf5ec2f8cb3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 38149 microversion: 2.1 time: 0.156886 Nov 24 03:06:45.546357 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 220/459] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:45 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 38149 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:06:45.897619 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fcca86f3-048a-486c-9784-e6756640add5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:45.898568 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fcca86f3-048a-486c-9784-e6756640add5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:45.930940 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fcca86f3-048a-486c-9784-e6756640add5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:45.932248 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fcca86f3-048a-486c-9784-e6756640add5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:45.935202 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fcca86f3-048a-486c-9784-e6756640add5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:45.938728 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fcca86f3-048a-486c-9784-e6756640add5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:46.340347 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-77cd560d-76c6-4d1c-b013-643ca6fc386e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:46.364161 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-77cd560d-76c6-4d1c-b013-643ca6fc386e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.872207 Nov 24 03:06:46.365200 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 240/460] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:45 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:46.388313 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-d1692e03-bc37-4c9f-b645-6281b710b03a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "966293a7-b3e4-417d-ab42-7b3f8cb2bacd"}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:46.391411 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-d1692e03-bc37-4c9f-b645-6281b710b03a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:46.399421 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d1692e03-bc37-4c9f-b645-6281b710b03a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:46.400778 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d1692e03-bc37-4c9f-b645-6281b710b03a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:46.402272 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d1692e03-bc37-4c9f-b645-6281b710b03a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:46.403047 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d1692e03-bc37-4c9f-b645-6281b710b03a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:46.749825 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-fcca86f3-048a-486c-9784-e6756640add5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:46.766830 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-fcca86f3-048a-486c-9784-e6756640add5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:46.778120 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-fcca86f3-048a-486c-9784-e6756640add5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:46.782914 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fcca86f3-048a-486c-9784-e6756640add5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1740 microversion: 2.20 time: 0.888997 Nov 24 03:06:46.788322 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 221/461] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:45 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1740 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:46.813902 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-40694349-b182-4268-b12d-1d49caf29c7b tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:46.822881 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-40694349-b182-4268-b12d-1d49caf29c7b tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:46.864560 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-40694349-b182-4268-b12d-1d49caf29c7b tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:46.868125 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-40694349-b182-4268-b12d-1d49caf29c7b tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:46.879144 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-40694349-b182-4268-b12d-1d49caf29c7b tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:46.880772 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-40694349-b182-4268-b12d-1d49caf29c7b tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:47.160957 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-d1692e03-bc37-4c9f-b645-6281b710b03a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "POST /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.794135 Nov 24 03:06:47.171940 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 241/462] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Nov 24 03:06:46 2021] POST /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c/os-volume_attachments => generated 194 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:06:47.207623 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b4778b8e-6079-4c76-b201-a67970621ffd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:47.215672 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b4778b8e-6079-4c76-b201-a67970621ffd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:47.252398 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b4778b8e-6079-4c76-b201-a67970621ffd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:47.252872 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b4778b8e-6079-4c76-b201-a67970621ffd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:47.263693 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b4778b8e-6079-4c76-b201-a67970621ffd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:47.272653 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b4778b8e-6079-4c76-b201-a67970621ffd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:47.427060 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b4778b8e-6079-4c76-b201-a67970621ffd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 200 len: 38280 microversion: 2.1 time: 0.251137 Nov 24 03:06:47.427798 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 242/463] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:06:47 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 38280 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:06:47.451140 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-53f4a832-2010-45ba-8f33-0144ec2011e0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:47.452016 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-53f4a832-2010-45ba-8f33-0144ec2011e0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:47.480587 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-53f4a832-2010-45ba-8f33-0144ec2011e0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:47.481186 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-53f4a832-2010-45ba-8f33-0144ec2011e0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:47.482713 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-53f4a832-2010-45ba-8f33-0144ec2011e0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:47.483412 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-53f4a832-2010-45ba-8f33-0144ec2011e0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:47.582692 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-40694349-b182-4268-b12d-1d49caf29c7b tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:47.595707 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-40694349-b182-4268-b12d-1d49caf29c7b tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 200 len: 1513 microversion: 2.1 time: 0.802168 Nov 24 03:06:47.596385 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 222/464] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:46 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 1513 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:47.604474 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a1a99691-22a8-49bc-9e67-0d20ca24f910 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:47.604985 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a1a99691-22a8-49bc-9e67-0d20ca24f910 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:47.649070 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a1a99691-22a8-49bc-9e67-0d20ca24f910 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:47.653768 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a1a99691-22a8-49bc-9e67-0d20ca24f910 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:47.658562 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a1a99691-22a8-49bc-9e67-0d20ca24f910 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:47.659294 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a1a99691-22a8-49bc-9e67-0d20ca24f910 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:47.700960 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a1a99691-22a8-49bc-9e67-0d20ca24f910 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/ips" status: 200 len: 147 microversion: 2.1 time: 0.103455 Nov 24 03:06:47.702258 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 223/465] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Nov 24 03:06:47 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/ips => generated 147 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:06:47.810994 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-dc012fd6-1801-4a7c-b53b-3f38b8b778d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:47.813160 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-dc012fd6-1801-4a7c-b53b-3f38b8b778d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:47.826674 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dc012fd6-1801-4a7c-b53b-3f38b8b778d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:47.834264 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dc012fd6-1801-4a7c-b53b-3f38b8b778d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:47.835447 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dc012fd6-1801-4a7c-b53b-3f38b8b778d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:47.836271 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dc012fd6-1801-4a7c-b53b-3f38b8b778d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:48.085706 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-53f4a832-2010-45ba-8f33-0144ec2011e0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:48.113565 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-53f4a832-2010-45ba-8f33-0144ec2011e0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.673514 Nov 24 03:06:48.114886 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 243/466] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:47 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:48.329962 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-dc012fd6-1801-4a7c-b53b-3f38b8b778d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:48.347465 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-dc012fd6-1801-4a7c-b53b-3f38b8b778d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:48.350044 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-dc012fd6-1801-4a7c-b53b-3f38b8b778d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:48.351907 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-dc012fd6-1801-4a7c-b53b-3f38b8b778d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1740 microversion: 2.20 time: 0.547870 Nov 24 03:06:48.358466 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 224/467] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:47 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1740 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:48.629579 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-181dbca3-1fbf-45ec-9953-e95037c4f8b2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:48.630438 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-181dbca3-1fbf-45ec-9953-e95037c4f8b2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:48.638795 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-c8221ec0-e1f8-4d7d-8d98-df6b3994baf6 req-ac07f27c-fe09-451c-91ae-47ebf47c3498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d57fe44d-e7d6-4188-b8aa-343ca2963f68", "name": "network-vif-deleted", "tag": "0369e643-d459-41b8-9f2d-380b361c90bf"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:48.640827 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-181dbca3-1fbf-45ec-9953-e95037c4f8b2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:48.641367 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-181dbca3-1fbf-45ec-9953-e95037c4f8b2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:48.649451 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-181dbca3-1fbf-45ec-9953-e95037c4f8b2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:48.650065 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-181dbca3-1fbf-45ec-9953-e95037c4f8b2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:48.652975 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:06:48.652975 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:06:48.715904 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-c8221ec0-e1f8-4d7d-8d98-df6b3994baf6 req-ac07f27c-fe09-451c-91ae-47ebf47c3498 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:48.728933 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-c8221ec0-e1f8-4d7d-8d98-df6b3994baf6 req-ac07f27c-fe09-451c-91ae-47ebf47c3498 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:48.771232 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-c8221ec0-e1f8-4d7d-8d98-df6b3994baf6 req-ac07f27c-fe09-451c-91ae-47ebf47c3498 service nova] Creating event network-vif-deleted:0369e643-d459-41b8-9f2d-380b361c90bf for instance d57fe44d-e7d6-4188-b8aa-343ca2963f68 on hv-cinder-81803 Nov 24 03:06:48.784598 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-c8221ec0-e1f8-4d7d-8d98-df6b3994baf6 req-ac07f27c-fe09-451c-91ae-47ebf47c3498 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166847 Nov 24 03:06:48.789881 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 244/468] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:06:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:06:48.839844 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-181dbca3-1fbf-45ec-9953-e95037c4f8b2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:48.856343 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-181dbca3-1fbf-45ec-9953-e95037c4f8b2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 200 len: 1471 microversion: 2.1 time: 0.227696 Nov 24 03:06:48.859473 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 225/469] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:48 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 1471 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:49.148069 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b451f29b-b433-46c8-bd46-71797b0e3fe4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:49.150334 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b451f29b-b433-46c8-bd46-71797b0e3fe4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:49.172655 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b451f29b-b433-46c8-bd46-71797b0e3fe4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:49.177274 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b451f29b-b433-46c8-bd46-71797b0e3fe4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:49.179742 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b451f29b-b433-46c8-bd46-71797b0e3fe4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:49.189593 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b451f29b-b433-46c8-bd46-71797b0e3fe4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:49.372585 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-add9d80f-3c0c-4a46-90bf-40ffcbace8a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:49.373293 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-add9d80f-3c0c-4a46-90bf-40ffcbace8a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:49.402237 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-add9d80f-3c0c-4a46-90bf-40ffcbace8a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:49.404630 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-add9d80f-3c0c-4a46-90bf-40ffcbace8a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:49.411714 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-add9d80f-3c0c-4a46-90bf-40ffcbace8a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:49.412431 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-add9d80f-3c0c-4a46-90bf-40ffcbace8a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:49.962731 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b451f29b-b433-46c8-bd46-71797b0e3fe4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:49.980337 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b451f29b-b433-46c8-bd46-71797b0e3fe4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.839029 Nov 24 03:06:49.995931 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-add9d80f-3c0c-4a46-90bf-40ffcbace8a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:50.002642 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 245/470] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:49 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:50.033347 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f44ca76d-557d-4ed5-b65f-3ad91539ff4a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:50.036478 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-add9d80f-3c0c-4a46-90bf-40ffcbace8a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:50.039309 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f44ca76d-557d-4ed5-b65f-3ad91539ff4a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: d57fe44d-e7d6-4188-b8aa-343ca2963f68] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:50.052620 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-add9d80f-3c0c-4a46-90bf-40ffcbace8a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:50.063654 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-add9d80f-3c0c-4a46-90bf-40ffcbace8a5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1740 microversion: 2.20 time: 0.694574 Nov 24 03:06:50.070960 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 226/471] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:49 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1740 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:06:50.074684 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f44ca76d-557d-4ed5-b65f-3ad91539ff4a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:50.081109 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f44ca76d-557d-4ed5-b65f-3ad91539ff4a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:50.083196 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f44ca76d-557d-4ed5-b65f-3ad91539ff4a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:50.089502 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f44ca76d-557d-4ed5-b65f-3ad91539ff4a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:50.145719 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-f44ca76d-557d-4ed5-b65f-3ad91539ff4a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] HTTP exception thrown: Instance d57fe44d-e7d6-4188-b8aa-343ca2963f68 could not be found. Nov 24 03:06:50.152238 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f44ca76d-557d-4ed5-b65f-3ad91539ff4a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Returning 404 to user: Instance d57fe44d-e7d6-4188-b8aa-343ca2963f68 could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:06:50.153646 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f44ca76d-557d-4ed5-b65f-3ad91539ff4a tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68" status: 404 len: 111 microversion: 2.1 time: 0.148922 Nov 24 03:06:50.154599 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 246/472] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:50 2021] GET /compute/v2.1/servers/d57fe44d-e7d6-4188-b8aa-343ca2963f68 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:06:50.167428 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e8f1b830-a16a-45e1-b3d3-07a1f4865b92 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:50.168915 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e8f1b830-a16a-45e1-b3d3-07a1f4865b92 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:50.192206 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8f1b830-a16a-45e1-b3d3-07a1f4865b92 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:50.192854 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8f1b830-a16a-45e1-b3d3-07a1f4865b92 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:50.194322 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8f1b830-a16a-45e1-b3d3-07a1f4865b92 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:50.195091 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8f1b830-a16a-45e1-b3d3-07a1f4865b92 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:50.251170 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e8f1b830-a16a-45e1-b3d3-07a1f4865b92 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:06:50.527115 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e8f1b830-a16a-45e1-b3d3-07a1f4865b92 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 204 len: 0 microversion: 2.1 time: 0.364116 Nov 24 03:06:50.528368 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 227/473] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:06:50 2021] DELETE /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:06:50.542608 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-cf23cf39-3c18-4978-a616-d63ceaa461c6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:50.543938 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-cf23cf39-3c18-4978-a616-d63ceaa461c6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:50.554337 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cf23cf39-3c18-4978-a616-d63ceaa461c6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:50.555849 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cf23cf39-3c18-4978-a616-d63ceaa461c6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:50.557305 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cf23cf39-3c18-4978-a616-d63ceaa461c6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:50.558069 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cf23cf39-3c18-4978-a616-d63ceaa461c6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:50.773806 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4ecc3bd2-40a3-4a47-837f-a99741954e8a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76fc869f-5bd8-4506-a993-df33bd89ce6e"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:50.775158 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4ecc3bd2-40a3-4a47-837f-a99741954e8a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:50.801294 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ecc3bd2-40a3-4a47-837f-a99741954e8a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:50.801739 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ecc3bd2-40a3-4a47-837f-a99741954e8a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:50.807152 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ecc3bd2-40a3-4a47-837f-a99741954e8a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:50.807152 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ecc3bd2-40a3-4a47-837f-a99741954e8a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:51.067191 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-cf23cf39-3c18-4978-a616-d63ceaa461c6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:51.075875 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-cf23cf39-3c18-4978-a616-d63ceaa461c6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 200 len: 1514 microversion: 2.1 time: 0.540085 Nov 24 03:06:51.076667 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 247/474] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:50 2021] GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 1514 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:06:51.099743 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c2e965fc-4584-42e7-9e2e-00f2eb8b286a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:51.100818 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c2e965fc-4584-42e7-9e2e-00f2eb8b286a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:51.108485 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c2e965fc-4584-42e7-9e2e-00f2eb8b286a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:51.110038 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c2e965fc-4584-42e7-9e2e-00f2eb8b286a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:51.111182 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c2e965fc-4584-42e7-9e2e-00f2eb8b286a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:51.111887 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c2e965fc-4584-42e7-9e2e-00f2eb8b286a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:51.586729 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c2e965fc-4584-42e7-9e2e-00f2eb8b286a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:51.624332 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c2e965fc-4584-42e7-9e2e-00f2eb8b286a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.545877 Nov 24 03:06:51.644271 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 248/475] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:51 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:51.644271 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-98546847-82c0-48e3-8c61-def7c6651872 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:51.644946 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4ecc3bd2-40a3-4a47-837f-a99741954e8a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.867960 Nov 24 03:06:51.645782 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-98546847-82c0-48e3-8c61-def7c6651872 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:51.646262 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 228/476] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Nov 24 03:06:50 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/os-volume_attachments => generated 194 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:06:51.650421 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-98546847-82c0-48e3-8c61-def7c6651872 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:51.651030 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-98546847-82c0-48e3-8c61-def7c6651872 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:51.651963 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-98546847-82c0-48e3-8c61-def7c6651872 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:51.653265 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-98546847-82c0-48e3-8c61-def7c6651872 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:51.943663 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-98546847-82c0-48e3-8c61-def7c6651872 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:51.959044 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-98546847-82c0-48e3-8c61-def7c6651872 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:51.960550 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-98546847-82c0-48e3-8c61-def7c6651872 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:51.961963 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-98546847-82c0-48e3-8c61-def7c6651872 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1740 microversion: 2.20 time: 0.330540 Nov 24 03:06:51.963532 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 249/477] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:51 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1740 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:52.095398 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2d8a2231-8822-4a28-833d-77f921846c2f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:52.096217 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2d8a2231-8822-4a28-833d-77f921846c2f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:52.115851 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d8a2231-8822-4a28-833d-77f921846c2f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:52.116836 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d8a2231-8822-4a28-833d-77f921846c2f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:52.121001 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d8a2231-8822-4a28-833d-77f921846c2f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:52.122012 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d8a2231-8822-4a28-833d-77f921846c2f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:52.542380 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2d8a2231-8822-4a28-833d-77f921846c2f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:52.569853 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2d8a2231-8822-4a28-833d-77f921846c2f tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 200 len: 1514 microversion: 2.1 time: 0.478744 Nov 24 03:06:52.585676 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 229/478] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:52 2021] GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 1514 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:52.666491 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c8e79191-4bd4-446c-a6cc-c49e8997401d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:52.667694 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c8e79191-4bd4-446c-a6cc-c49e8997401d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:52.679323 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c8e79191-4bd4-446c-a6cc-c49e8997401d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:52.681745 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c8e79191-4bd4-446c-a6cc-c49e8997401d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:52.683495 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c8e79191-4bd4-446c-a6cc-c49e8997401d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:52.684542 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c8e79191-4bd4-446c-a6cc-c49e8997401d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:52.988161 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-189db2a7-3e49-4bc7-94df-22a676094ea0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:52.994676 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-189db2a7-3e49-4bc7-94df-22a676094ea0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:53.016099 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-189db2a7-3e49-4bc7-94df-22a676094ea0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:53.018672 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-189db2a7-3e49-4bc7-94df-22a676094ea0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:53.021590 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-189db2a7-3e49-4bc7-94df-22a676094ea0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:53.029780 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-189db2a7-3e49-4bc7-94df-22a676094ea0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:53.167963 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c8e79191-4bd4-446c-a6cc-c49e8997401d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:53.179824 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c8e79191-4bd4-446c-a6cc-c49e8997401d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.525058 Nov 24 03:06:53.180428 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 250/479] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:52 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:53.415764 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-189db2a7-3e49-4bc7-94df-22a676094ea0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:53.431395 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-189db2a7-3e49-4bc7-94df-22a676094ea0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:53.433543 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-189db2a7-3e49-4bc7-94df-22a676094ea0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:53.435333 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-189db2a7-3e49-4bc7-94df-22a676094ea0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1740 microversion: 2.20 time: 0.455368 Nov 24 03:06:53.438430 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 230/480] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:52 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1740 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:06:53.591507 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-3f312d0a-e8f9-4062-a3f3-67d6dea117d4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:53.592462 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-3f312d0a-e8f9-4062-a3f3-67d6dea117d4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:53.612785 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3f312d0a-e8f9-4062-a3f3-67d6dea117d4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:53.613591 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3f312d0a-e8f9-4062-a3f3-67d6dea117d4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:53.614730 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3f312d0a-e8f9-4062-a3f3-67d6dea117d4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:53.615366 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3f312d0a-e8f9-4062-a3f3-67d6dea117d4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:53.791624 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-3f312d0a-e8f9-4062-a3f3-67d6dea117d4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:53.795307 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-11e55317-d04f-4cbb-87d8-f765ce321f63 req-ab0778b8-a19e-4882-8abb-5f7f173f3c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba70ac89-9809-498b-9501-9c29c63b0519", "name": "network-vif-deleted", "tag": "fccf5b03-6c42-421d-bf50-f86815f42c74"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:53.797816 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:06:53.797816 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:06:53.807528 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-3f312d0a-e8f9-4062-a3f3-67d6dea117d4 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 200 len: 1472 microversion: 2.1 time: 0.218367 Nov 24 03:06:53.810019 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 251/481] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:53 2021] GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:53.846916 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-11e55317-d04f-4cbb-87d8-f765ce321f63 req-ab0778b8-a19e-4882-8abb-5f7f173f3c57 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:53.848510 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-11e55317-d04f-4cbb-87d8-f765ce321f63 req-ab0778b8-a19e-4882-8abb-5f7f173f3c57 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:53.879520 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-11e55317-d04f-4cbb-87d8-f765ce321f63 req-ab0778b8-a19e-4882-8abb-5f7f173f3c57 service nova] Creating event network-vif-deleted:fccf5b03-6c42-421d-bf50-f86815f42c74 for instance ba70ac89-9809-498b-9501-9c29c63b0519 on hv-cinder-81803 Nov 24 03:06:53.899041 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-11e55317-d04f-4cbb-87d8-f765ce321f63 req-ab0778b8-a19e-4882-8abb-5f7f173f3c57 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104189 Nov 24 03:06:53.901231 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 231/482] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:06:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:06:54.208196 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-786b8837-d47f-4868-b33b-75c61cc529f5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:54.209222 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-786b8837-d47f-4868-b33b-75c61cc529f5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:54.234841 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-786b8837-d47f-4868-b33b-75c61cc529f5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:54.235651 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-786b8837-d47f-4868-b33b-75c61cc529f5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:54.237954 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-786b8837-d47f-4868-b33b-75c61cc529f5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:54.240445 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-786b8837-d47f-4868-b33b-75c61cc529f5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:54.464692 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e26678dd-6933-4163-847d-aa288cf3ff1d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:54.466096 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e26678dd-6933-4163-847d-aa288cf3ff1d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:54.481640 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-786b8837-d47f-4868-b33b-75c61cc529f5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:54.493709 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-786b8837-d47f-4868-b33b-75c61cc529f5 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.291958 Nov 24 03:06:54.495173 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 252/483] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:54 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:54.500260 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e26678dd-6933-4163-847d-aa288cf3ff1d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:54.500713 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e26678dd-6933-4163-847d-aa288cf3ff1d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:54.503478 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e26678dd-6933-4163-847d-aa288cf3ff1d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:54.504142 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e26678dd-6933-4163-847d-aa288cf3ff1d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:54.793160 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e26678dd-6933-4163-847d-aa288cf3ff1d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:54.822139 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e26678dd-6933-4163-847d-aa288cf3ff1d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:54.824623 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e26678dd-6933-4163-847d-aa288cf3ff1d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:54.826108 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e26678dd-6933-4163-847d-aa288cf3ff1d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1740 microversion: 2.20 time: 0.370345 Nov 24 03:06:54.842347 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 232/484] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:54 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1740 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:06:54.848115 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-759500bb-b499-4334-a392-d5104e8c1495 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:54.850353 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0762002c-b4b8-4618-a702-931754d2943b tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:54.850803 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-759500bb-b499-4334-a392-d5104e8c1495 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: ba70ac89-9809-498b-9501-9c29c63b0519] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:54.851127 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0762002c-b4b8-4618-a702-931754d2943b tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:54.858723 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0762002c-b4b8-4618-a702-931754d2943b tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:54.860241 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0762002c-b4b8-4618-a702-931754d2943b tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:54.861439 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0762002c-b4b8-4618-a702-931754d2943b tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:54.862246 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0762002c-b4b8-4618-a702-931754d2943b tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:54.881364 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-759500bb-b499-4334-a392-d5104e8c1495 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:54.881863 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-759500bb-b499-4334-a392-d5104e8c1495 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:54.882708 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-759500bb-b499-4334-a392-d5104e8c1495 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:54.883144 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-759500bb-b499-4334-a392-d5104e8c1495 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:54.930338 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-759500bb-b499-4334-a392-d5104e8c1495 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] HTTP exception thrown: Instance ba70ac89-9809-498b-9501-9c29c63b0519 could not be found. Nov 24 03:06:54.931554 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-759500bb-b499-4334-a392-d5104e8c1495 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Returning 404 to user: Instance ba70ac89-9809-498b-9501-9c29c63b0519 could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:06:54.942261 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-759500bb-b499-4334-a392-d5104e8c1495 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519" status: 404 len: 111 microversion: 2.1 time: 0.115455 Nov 24 03:06:54.943463 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 253/485] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:54 2021] GET /compute/v2.1/servers/ba70ac89-9809-498b-9501-9c29c63b0519 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:06:55.252193 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0762002c-b4b8-4618-a702-931754d2943b tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:55.348990 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0762002c-b4b8-4618-a702-931754d2943b tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1594 microversion: 2.1 time: 0.505232 Nov 24 03:06:55.358136 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 233/486] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:54 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1594 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:55.495874 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2dc78d6f-1d5e-4d8d-bb34-c69a03927657 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:55.498143 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2dc78d6f-1d5e-4d8d-bb34-c69a03927657 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:55.525854 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f96f9987-5530-4b05-a859-f73efc419c16 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:55.527941 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2dc78d6f-1d5e-4d8d-bb34-c69a03927657 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:55.528964 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2dc78d6f-1d5e-4d8d-bb34-c69a03927657 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:55.532509 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f96f9987-5530-4b05-a859-f73efc419c16 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:55.537502 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2dc78d6f-1d5e-4d8d-bb34-c69a03927657 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:55.539755 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2dc78d6f-1d5e-4d8d-bb34-c69a03927657 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:55.554658 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f96f9987-5530-4b05-a859-f73efc419c16 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:55.556152 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f96f9987-5530-4b05-a859-f73efc419c16 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:55.558370 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f96f9987-5530-4b05-a859-f73efc419c16 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:55.559351 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f96f9987-5530-4b05-a859-f73efc419c16 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:55.608280 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2dc78d6f-1d5e-4d8d-bb34-c69a03927657 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Going to try to terminate instance {{(pid=116331) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:06:55.803164 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2dc78d6f-1d5e-4d8d-bb34-c69a03927657 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 204 len: 0 microversion: 2.1 time: 0.317267 Nov 24 03:06:55.804261 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 254/487] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:06:55 2021] DELETE /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:06:55.825963 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c93a1b1b-833f-44a6-a494-722454658c0e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:55.827157 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c93a1b1b-833f-44a6-a494-722454658c0e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:55.835250 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c93a1b1b-833f-44a6-a494-722454658c0e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:55.836043 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c93a1b1b-833f-44a6-a494-722454658c0e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:55.837052 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c93a1b1b-833f-44a6-a494-722454658c0e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:55.837667 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c93a1b1b-833f-44a6-a494-722454658c0e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:56.193476 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f96f9987-5530-4b05-a859-f73efc419c16 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:56.211094 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c93a1b1b-833f-44a6-a494-722454658c0e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:56.236824 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c93a1b1b-833f-44a6-a494-722454658c0e tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1514 microversion: 2.1 time: 0.425401 Nov 24 03:06:56.240626 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 255/488] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:55 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1514 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:56.248468 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c6192f6f-71c2-4bec-ae07-1830da301d8c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:56.249596 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c6192f6f-71c2-4bec-ae07-1830da301d8c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:56.259711 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f96f9987-5530-4b05-a859-f73efc419c16 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.741836 Nov 24 03:06:56.261188 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 234/489] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:55 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:06:56.268074 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c6192f6f-71c2-4bec-ae07-1830da301d8c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:56.268824 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c6192f6f-71c2-4bec-ae07-1830da301d8c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:56.271113 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c6192f6f-71c2-4bec-ae07-1830da301d8c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:56.281683 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c6192f6f-71c2-4bec-ae07-1830da301d8c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:56.707193 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c6192f6f-71c2-4bec-ae07-1830da301d8c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:56.717098 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c6192f6f-71c2-4bec-ae07-1830da301d8c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:56.722763 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c6192f6f-71c2-4bec-ae07-1830da301d8c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:56.724134 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c6192f6f-71c2-4bec-ae07-1830da301d8c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1722 microversion: 2.20 time: 0.481860 Nov 24 03:06:56.724804 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 256/490] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:56 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1722 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:06:57.256308 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c22531d6-b35f-4127-b124-1513994cc1b2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:57.257155 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c22531d6-b35f-4127-b124-1513994cc1b2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:57.266160 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c22531d6-b35f-4127-b124-1513994cc1b2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:57.267030 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c22531d6-b35f-4127-b124-1513994cc1b2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:57.268637 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c22531d6-b35f-4127-b124-1513994cc1b2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:57.269100 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c22531d6-b35f-4127-b124-1513994cc1b2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:57.279074 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-97728155-26fc-4724-a776-b91ed408caee tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:57.280840 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-97728155-26fc-4724-a776-b91ed408caee tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:57.298500 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-97728155-26fc-4724-a776-b91ed408caee tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:57.299305 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-97728155-26fc-4724-a776-b91ed408caee tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:57.303526 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-97728155-26fc-4724-a776-b91ed408caee tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:57.304282 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-97728155-26fc-4724-a776-b91ed408caee tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:57.580148 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c22531d6-b35f-4127-b124-1513994cc1b2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:57.682082 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c22531d6-b35f-4127-b124-1513994cc1b2 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1514 microversion: 2.1 time: 0.429942 Nov 24 03:06:57.694224 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 235/491] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:57 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1514 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:06:57.726488 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-97728155-26fc-4724-a776-b91ed408caee tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:57.748261 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8bd86632-00e6-4714-b05b-9b65011e41f1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:57.749286 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8bd86632-00e6-4714-b05b-9b65011e41f1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:57.762695 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8bd86632-00e6-4714-b05b-9b65011e41f1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:57.763453 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8bd86632-00e6-4714-b05b-9b65011e41f1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:57.765145 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8bd86632-00e6-4714-b05b-9b65011e41f1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:57.766886 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8bd86632-00e6-4714-b05b-9b65011e41f1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:57.777841 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-97728155-26fc-4724-a776-b91ed408caee tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.503964 Nov 24 03:06:57.780565 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 257/492] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:57 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:06:58.355188 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8bd86632-00e6-4714-b05b-9b65011e41f1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:58.365950 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8bd86632-00e6-4714-b05b-9b65011e41f1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:58.369602 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8bd86632-00e6-4714-b05b-9b65011e41f1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:58.371356 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8bd86632-00e6-4714-b05b-9b65011e41f1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1722 microversion: 2.20 time: 0.630833 Nov 24 03:06:58.372541 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 236/493] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:57 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1722 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:06:58.702612 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b82d085a-8e5a-476f-9681-975704961909 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:58.705219 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b82d085a-8e5a-476f-9681-975704961909 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:58.717175 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b82d085a-8e5a-476f-9681-975704961909 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:58.718957 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b82d085a-8e5a-476f-9681-975704961909 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:58.720801 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b82d085a-8e5a-476f-9681-975704961909 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:58.721269 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b82d085a-8e5a-476f-9681-975704961909 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:58.802993 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-990decd3-1dfb-43a2-8b2c-2dcbe054772b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:58.806304 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-990decd3-1dfb-43a2-8b2c-2dcbe054772b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:58.831242 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-990decd3-1dfb-43a2-8b2c-2dcbe054772b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:58.831700 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-990decd3-1dfb-43a2-8b2c-2dcbe054772b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:58.832575 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-990decd3-1dfb-43a2-8b2c-2dcbe054772b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:58.833019 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-990decd3-1dfb-43a2-8b2c-2dcbe054772b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:59.317072 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b82d085a-8e5a-476f-9681-975704961909 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:59.357646 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b82d085a-8e5a-476f-9681-975704961909 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1514 microversion: 2.1 time: 0.659595 Nov 24 03:06:59.358861 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 258/494] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:58 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1514 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:59.380208 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-c8844d08-e078-4860-b0db-e0c34c9172c1 req-a22fdbdc-bc3e-4b7b-8719-ac7a080c6e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfaf6d4e-4188-451d-8af8-32300d13ae2d", "name": "network-vif-unplugged", "status": "completed", "tag": "521a966d-715d-42d8-a2e3-077f7788aac2"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:59.384114 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:06:59.384114 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:06:59.427009 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-c8844d08-e078-4860-b0db-e0c34c9172c1 req-a22fdbdc-bc3e-4b7b-8719-ac7a080c6e2c service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:59.431164 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-c8844d08-e078-4860-b0db-e0c34c9172c1 req-a22fdbdc-bc3e-4b7b-8719-ac7a080c6e2c service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:59.475190 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-c8844d08-e078-4860-b0db-e0c34c9172c1 req-a22fdbdc-bc3e-4b7b-8719-ac7a080c6e2c service nova] Creating event network-vif-unplugged:521a966d-715d-42d8-a2e3-077f7788aac2 for instance dfaf6d4e-4188-451d-8af8-32300d13ae2d on hv-cinder-81803 Nov 24 03:06:59.488231 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-c8844d08-e078-4860-b0db-e0c34c9172c1 req-a22fdbdc-bc3e-4b7b-8719-ac7a080c6e2c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126802 Nov 24 03:06:59.490290 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 259/495] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:06:59 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:06:59.519401 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e2b85dd9-ff3d-425f-9b68-118abc03021b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:06:59.521777 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e2b85dd9-ff3d-425f-9b68-118abc03021b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:06:59.535815 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e2b85dd9-ff3d-425f-9b68-118abc03021b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:59.539185 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e2b85dd9-ff3d-425f-9b68-118abc03021b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:59.542098 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e2b85dd9-ff3d-425f-9b68-118abc03021b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:59.547711 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e2b85dd9-ff3d-425f-9b68-118abc03021b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:59.720134 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-990decd3-1dfb-43a2-8b2c-2dcbe054772b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:59.740024 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-990decd3-1dfb-43a2-8b2c-2dcbe054772b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.945609 Nov 24 03:06:59.740631 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 237/496] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:06:58 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:06:59.852124 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-bebb7d29-0529-4d16-a325-3c9e45786f61 req-12d66f36-4108-40be-aeb0-ca6b6f1bd446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a175fec-cd0a-49a4-a612-b3698836edef", "name": "network-vif-deleted", "tag": "2d767caa-bca8-41a0-b79c-dbef07431926"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:06:59.854435 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:06:59.854435 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:06:59.894811 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-bebb7d29-0529-4d16-a325-3c9e45786f61 req-12d66f36-4108-40be-aeb0-ca6b6f1bd446 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:06:59.896330 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-bebb7d29-0529-4d16-a325-3c9e45786f61 req-12d66f36-4108-40be-aeb0-ca6b6f1bd446 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:06:59.938728 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-bebb7d29-0529-4d16-a325-3c9e45786f61 req-12d66f36-4108-40be-aeb0-ca6b6f1bd446 service nova] Creating event network-vif-deleted:2d767caa-bca8-41a0-b79c-dbef07431926 for instance 9a175fec-cd0a-49a4-a612-b3698836edef on hv-cinder-81803 Nov 24 03:06:59.946530 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-bebb7d29-0529-4d16-a325-3c9e45786f61 req-12d66f36-4108-40be-aeb0-ca6b6f1bd446 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106553 Nov 24 03:06:59.948383 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 238/497] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:06:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:06:59.956939 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e2b85dd9-ff3d-425f-9b68-118abc03021b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:59.966824 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e2b85dd9-ff3d-425f-9b68-118abc03021b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:59.979285 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e2b85dd9-ff3d-425f-9b68-118abc03021b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:06:59.980901 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e2b85dd9-ff3d-425f-9b68-118abc03021b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1725 microversion: 2.20 time: 0.488636 Nov 24 03:06:59.983063 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 260/498] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:06:59 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1725 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:00.008774 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-49e89dd9-7898-45ea-b9a6-4253de1cb6b5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc28d9c0-c6c0-473e-b696-74a0efd054bd"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:07:00.010128 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-49e89dd9-7898-45ea-b9a6-4253de1cb6b5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:00.018592 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-49e89dd9-7898-45ea-b9a6-4253de1cb6b5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:00.019311 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-49e89dd9-7898-45ea-b9a6-4253de1cb6b5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:00.020430 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-49e89dd9-7898-45ea-b9a6-4253de1cb6b5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:00.021223 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-49e89dd9-7898-45ea-b9a6-4253de1cb6b5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:00.379472 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-293d9f60-61cd-4a4b-98cd-744735b31fc6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:00.380573 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-293d9f60-61cd-4a4b-98cd-744735b31fc6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:00.390814 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-293d9f60-61cd-4a4b-98cd-744735b31fc6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:00.392347 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-293d9f60-61cd-4a4b-98cd-744735b31fc6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:00.393761 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-293d9f60-61cd-4a4b-98cd-744735b31fc6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:00.394449 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-293d9f60-61cd-4a4b-98cd-744735b31fc6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:00.478414 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-293d9f60-61cd-4a4b-98cd-744735b31fc6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:00.481085 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-293d9f60-61cd-4a4b-98cd-744735b31fc6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:00.483894 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.objects.instance [None req-293d9f60-61cd-4a4b-98cd-744735b31fc6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lazy-loading 'fault' on Instance uuid 9a175fec-cd0a-49a4-a612-b3698836edef {{(pid=116331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:07:00.553353 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-293d9f60-61cd-4a4b-98cd-744735b31fc6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7721d1277c63459dacf166e44cacf3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8250c30ab9492ab167e4dd03c96be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:00.566524 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-293d9f60-61cd-4a4b-98cd-744735b31fc6 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 200 len: 1307 microversion: 2.1 time: 0.190994 Nov 24 03:07:00.586109 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 261/499] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:00 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 1307 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:00.639312 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-49e89dd9-7898-45ea-b9a6-4253de1cb6b5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.635866 Nov 24 03:07:00.642071 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 239/500] 10.222.0.52 () {62 vars in 1363 bytes} [Wed Nov 24 03:07:00 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/os-volume_attachments => generated 188 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:07:00.768285 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-65bb4f55-fa2e-4292-9fda-16e8923af67b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:00.769951 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-65bb4f55-fa2e-4292-9fda-16e8923af67b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:00.788565 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-65bb4f55-fa2e-4292-9fda-16e8923af67b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:00.789190 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-65bb4f55-fa2e-4292-9fda-16e8923af67b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:00.790234 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-65bb4f55-fa2e-4292-9fda-16e8923af67b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:00.790747 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-65bb4f55-fa2e-4292-9fda-16e8923af67b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:00.914950 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-07317223-7a36-49da-8f97-0d114e3c99e3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:07:00.915542 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-07317223-7a36-49da-8f97-0d114e3c99e3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:00.930102 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-07317223-7a36-49da-8f97-0d114e3c99e3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:00.930981 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-07317223-7a36-49da-8f97-0d114e3c99e3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:00.932013 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-07317223-7a36-49da-8f97-0d114e3c99e3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:00.932559 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-07317223-7a36-49da-8f97-0d114e3c99e3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:01.247108 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-65bb4f55-fa2e-4292-9fda-16e8923af67b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:01.260532 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-65bb4f55-fa2e-4292-9fda-16e8923af67b tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.495813 Nov 24 03:07:01.270849 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 262/501] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:00 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:07:01.272694 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7b3e573f-6966-41db-ae6b-788ed652b1db tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:07:01.291008 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7b3e573f-6966-41db-ae6b-788ed652b1db tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:01.291473 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7b3e573f-6966-41db-ae6b-788ed652b1db tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:01.310828 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-07317223-7a36-49da-8f97-0d114e3c99e3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action" status: 202 len: 0 microversion: 2.20 time: 0.397742 Nov 24 03:07:01.311628 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 240/502] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:07:00 2021] POST /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:07:01.333759 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d56f7c6d-cb8d-42e1-8e0c-68b50befce69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:01.339163 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d56f7c6d-cb8d-42e1-8e0c-68b50befce69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:01.366857 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d56f7c6d-cb8d-42e1-8e0c-68b50befce69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:01.370799 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d56f7c6d-cb8d-42e1-8e0c-68b50befce69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:01.371857 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d56f7c6d-cb8d-42e1-8e0c-68b50befce69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:01.373747 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d56f7c6d-cb8d-42e1-8e0c-68b50befce69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:01.439355 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-7b3e573f-6966-41db-ae6b-788ed652b1db tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Going to try to stop instance {{(pid=116331) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 24 03:07:01.523097 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7b3e573f-6966-41db-ae6b-788ed652b1db tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 202 len: 0 microversion: 2.1 time: 0.254156 Nov 24 03:07:01.524138 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 263/503] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:07:01 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:07:01.550838 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0d42d298-6d7f-4a6b-8051-891fae6507b3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:01.553870 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0d42d298-6d7f-4a6b-8051-891fae6507b3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:01.571110 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0d42d298-6d7f-4a6b-8051-891fae6507b3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:01.571644 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0d42d298-6d7f-4a6b-8051-891fae6507b3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:01.572574 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0d42d298-6d7f-4a6b-8051-891fae6507b3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:01.573082 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0d42d298-6d7f-4a6b-8051-891fae6507b3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:01.854227 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d56f7c6d-cb8d-42e1-8e0c-68b50befce69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:01.866966 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d56f7c6d-cb8d-42e1-8e0c-68b50befce69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:01.875105 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d56f7c6d-cb8d-42e1-8e0c-68b50befce69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:01.876189 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d56f7c6d-cb8d-42e1-8e0c-68b50befce69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1751 microversion: 2.20 time: 0.554400 Nov 24 03:07:01.890971 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 241/504] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:01 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1751 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:01.901735 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-be3f00cf-85a6-45c6-a2ba-e65f92688119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:01.902411 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-be3f00cf-85a6-45c6-a2ba-e65f92688119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] [instance: 9a175fec-cd0a-49a4-a612-b3698836edef] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:01.919834 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-be3f00cf-85a6-45c6-a2ba-e65f92688119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:01.922034 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-be3f00cf-85a6-45c6-a2ba-e65f92688119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:01.922034 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-be3f00cf-85a6-45c6-a2ba-e65f92688119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:01.922881 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-be3f00cf-85a6-45c6-a2ba-e65f92688119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:01.935663 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0d42d298-6d7f-4a6b-8051-891fae6507b3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:01.945877 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0d42d298-6d7f-4a6b-8051-891fae6507b3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1724 microversion: 2.1 time: 0.411798 Nov 24 03:07:01.962097 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 264/505] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:01 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1724 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:01.966154 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-be3f00cf-85a6-45c6-a2ba-e65f92688119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] HTTP exception thrown: Instance 9a175fec-cd0a-49a4-a612-b3698836edef could not be found. Nov 24 03:07:01.967212 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-be3f00cf-85a6-45c6-a2ba-e65f92688119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] Returning 404 to user: Instance 9a175fec-cd0a-49a4-a612-b3698836edef could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:07:01.968615 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-be3f00cf-85a6-45c6-a2ba-e65f92688119 tempest-AttachVolumeNegativeTest-284372276 tempest-AttachVolumeNegativeTest-284372276-project] 10.222.0.52 "GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef" status: 404 len: 111 microversion: 2.1 time: 0.076120 Nov 24 03:07:01.972354 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 242/506] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:01 2021] GET /compute/v2.1/servers/9a175fec-cd0a-49a4-a612-b3698836edef => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:07:01.985017 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-ba5412b0-0b7c-4eaa-9bb3-f3e558792f0c req-3dbd5b16-9d94-4beb-94eb-2831bf146c60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7751b5e-4ff9-4a10-be90-35dc8498899c", "tag": "2ece000a-104a-46f1-8ab6-c4772032c9cf"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:07:01.986888 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:07:01.986888 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:07:02.016388 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-ba5412b0-0b7c-4eaa-9bb3-f3e558792f0c req-3dbd5b16-9d94-4beb-94eb-2831bf146c60 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:02.016855 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-ba5412b0-0b7c-4eaa-9bb3-f3e558792f0c req-3dbd5b16-9d94-4beb-94eb-2831bf146c60 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:02.063434 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-ba5412b0-0b7c-4eaa-9bb3-f3e558792f0c req-3dbd5b16-9d94-4beb-94eb-2831bf146c60 service nova] Creating event network-changed:2ece000a-104a-46f1-8ab6-c4772032c9cf for instance d7751b5e-4ff9-4a10-be90-35dc8498899c on hv-cinder-81803 Nov 24 03:07:02.074505 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-ba5412b0-0b7c-4eaa-9bb3-f3e558792f0c req-3dbd5b16-9d94-4beb-94eb-2831bf146c60 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103542 Nov 24 03:07:02.076136 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 265/507] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:07:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:07:02.280089 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-baf25f3b-fe94-4595-9669-49f1fa9ffc00 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:02.280918 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-baf25f3b-fe94-4595-9669-49f1fa9ffc00 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:02.314369 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-baf25f3b-fe94-4595-9669-49f1fa9ffc00 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:02.314866 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-baf25f3b-fe94-4595-9669-49f1fa9ffc00 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:02.315646 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-baf25f3b-fe94-4595-9669-49f1fa9ffc00 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:02.316061 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-baf25f3b-fe94-4595-9669-49f1fa9ffc00 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:02.896473 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-db6476e3-f5f5-4416-b3f7-a16d4a47b99d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:02.897187 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-db6476e3-f5f5-4416-b3f7-a16d4a47b99d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:02.917835 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-db6476e3-f5f5-4416-b3f7-a16d4a47b99d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:02.921575 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-db6476e3-f5f5-4416-b3f7-a16d4a47b99d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:02.923644 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-db6476e3-f5f5-4416-b3f7-a16d4a47b99d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:02.924282 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-db6476e3-f5f5-4416-b3f7-a16d4a47b99d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:03.224223 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-baf25f3b-fe94-4595-9669-49f1fa9ffc00 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:03.238311 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-baf25f3b-fe94-4595-9669-49f1fa9ffc00 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.963969 Nov 24 03:07:03.241075 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 243/508] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:02 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:07:03.248087 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6a8eccb1-faa7-4790-b7c3-3940f149aacc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:03.252390 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6a8eccb1-faa7-4790-b7c3-3940f149aacc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:03.270738 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6a8eccb1-faa7-4790-b7c3-3940f149aacc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:03.279192 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6a8eccb1-faa7-4790-b7c3-3940f149aacc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:03.280507 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6a8eccb1-faa7-4790-b7c3-3940f149aacc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:03.283738 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6a8eccb1-faa7-4790-b7c3-3940f149aacc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:03.707832 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6a8eccb1-faa7-4790-b7c3-3940f149aacc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:03.761402 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6a8eccb1-faa7-4790-b7c3-3940f149aacc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1724 microversion: 2.1 time: 0.518230 Nov 24 03:07:03.764817 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 244/509] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:03 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1724 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:03.866233 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-db6476e3-f5f5-4416-b3f7-a16d4a47b99d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:03.879799 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-db6476e3-f5f5-4416-b3f7-a16d4a47b99d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:03.883933 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-db6476e3-f5f5-4416-b3f7-a16d4a47b99d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:03.885174 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-db6476e3-f5f5-4416-b3f7-a16d4a47b99d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1751 microversion: 2.20 time: 0.993260 Nov 24 03:07:03.888826 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 266/510] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:02 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1751 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:04.259196 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f5d65bcf-31c1-4647-86dd-b9bf85b6def6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:04.260568 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f5d65bcf-31c1-4647-86dd-b9bf85b6def6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:04.270423 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f5d65bcf-31c1-4647-86dd-b9bf85b6def6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:04.274666 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f5d65bcf-31c1-4647-86dd-b9bf85b6def6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:04.279765 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f5d65bcf-31c1-4647-86dd-b9bf85b6def6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:04.280796 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f5d65bcf-31c1-4647-86dd-b9bf85b6def6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:04.473900 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-1975ee31-73b8-4803-9140-2389eaffd80a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1375300103"}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:07:04.474553 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-1975ee31-73b8-4803-9140-2389eaffd80a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:04.484351 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1975ee31-73b8-4803-9140-2389eaffd80a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:04.484821 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1975ee31-73b8-4803-9140-2389eaffd80a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:04.485566 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1975ee31-73b8-4803-9140-2389eaffd80a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:04.489711 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1975ee31-73b8-4803-9140-2389eaffd80a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:04.578922 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f5d65bcf-31c1-4647-86dd-b9bf85b6def6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:04.595885 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f5d65bcf-31c1-4647-86dd-b9bf85b6def6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.339487 Nov 24 03:07:04.598538 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 245/511] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:04 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:04.764786 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.network.security_group_api [None req-1975ee31-73b8-4803-9140-2389eaffd80a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Adding security group 9758eaa8-8f9d-4d8e-82a2-3662d9e44202 to port 2ece000a-104a-46f1-8ab6-c4772032c9cf Nov 24 03:07:04.785189 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b7a1cb60-2439-41f8-afec-5edcbff4a0ba tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:04.786145 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b7a1cb60-2439-41f8-afec-5edcbff4a0ba tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:04.794667 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b7a1cb60-2439-41f8-afec-5edcbff4a0ba tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:04.803895 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b7a1cb60-2439-41f8-afec-5edcbff4a0ba tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:04.805126 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b7a1cb60-2439-41f8-afec-5edcbff4a0ba tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:04.805720 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b7a1cb60-2439-41f8-afec-5edcbff4a0ba tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:05.052794 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b7a1cb60-2439-41f8-afec-5edcbff4a0ba tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:05.071845 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b7a1cb60-2439-41f8-afec-5edcbff4a0ba tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1724 microversion: 2.1 time: 0.291103 Nov 24 03:07:05.074378 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 246/512] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:04 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1724 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:07:05.080646 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a51cd01e-f356-4d2b-93c3-7671de792355 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:05.081533 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a51cd01e-f356-4d2b-93c3-7671de792355 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:05.088711 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a51cd01e-f356-4d2b-93c3-7671de792355 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:05.089485 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a51cd01e-f356-4d2b-93c3-7671de792355 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:05.091150 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a51cd01e-f356-4d2b-93c3-7671de792355 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:05.091794 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a51cd01e-f356-4d2b-93c3-7671de792355 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:05.314573 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a51cd01e-f356-4d2b-93c3-7671de792355 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:05.331378 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a51cd01e-f356-4d2b-93c3-7671de792355 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:05.333510 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a51cd01e-f356-4d2b-93c3-7671de792355 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:05.335507 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a51cd01e-f356-4d2b-93c3-7671de792355 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1751 microversion: 2.20 time: 0.259627 Nov 24 03:07:05.336369 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 247/513] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:05 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1751 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:05.416217 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-1975ee31-73b8-4803-9140-2389eaffd80a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "POST /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c/action" status: 202 len: 0 microversion: 2.1 time: 0.947412 Nov 24 03:07:05.417495 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 267/514] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:07:04 2021] POST /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c/action => generated 0 bytes in 949 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:07:05.427435 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6dfcb299-8437-476e-92d6-942e8435dc54 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:05.428051 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6dfcb299-8437-476e-92d6-942e8435dc54 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:05.434748 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-8146894c-9104-4edf-b7ae-b013ab487c7b req-e739e72b-85e3-4515-bdfd-ddbd2d225032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7751b5e-4ff9-4a10-be90-35dc8498899c", "tag": "2ece000a-104a-46f1-8ab6-c4772032c9cf"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:07:05.436936 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:07:05.436936 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:07:05.443573 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6dfcb299-8437-476e-92d6-942e8435dc54 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:05.444024 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6dfcb299-8437-476e-92d6-942e8435dc54 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:05.444847 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6dfcb299-8437-476e-92d6-942e8435dc54 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:05.445288 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6dfcb299-8437-476e-92d6-942e8435dc54 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:05.459429 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-8146894c-9104-4edf-b7ae-b013ab487c7b req-e739e72b-85e3-4515-bdfd-ddbd2d225032 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:05.460291 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-8146894c-9104-4edf-b7ae-b013ab487c7b req-e739e72b-85e3-4515-bdfd-ddbd2d225032 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:05.497089 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-8146894c-9104-4edf-b7ae-b013ab487c7b req-e739e72b-85e3-4515-bdfd-ddbd2d225032 service nova] Creating event network-changed:2ece000a-104a-46f1-8ab6-c4772032c9cf for instance d7751b5e-4ff9-4a10-be90-35dc8498899c on hv-cinder-81803 Nov 24 03:07:05.511535 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-8146894c-9104-4edf-b7ae-b013ab487c7b req-e739e72b-85e3-4515-bdfd-ddbd2d225032 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082799 Nov 24 03:07:05.514157 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 268/515] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:07:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:07:05.618063 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-926ebbd6-e0ae-48d0-ab4c-09e9298825a9 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:05.618934 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-926ebbd6-e0ae-48d0-ab4c-09e9298825a9 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:05.638044 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-926ebbd6-e0ae-48d0-ab4c-09e9298825a9 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:05.638044 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-926ebbd6-e0ae-48d0-ab4c-09e9298825a9 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:05.638044 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-926ebbd6-e0ae-48d0-ab4c-09e9298825a9 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:05.638044 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-926ebbd6-e0ae-48d0-ab4c-09e9298825a9 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:05.896964 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-926ebbd6-e0ae-48d0-ab4c-09e9298825a9 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:05.910662 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-926ebbd6-e0ae-48d0-ab4c-09e9298825a9 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.298371 Nov 24 03:07:05.911958 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 269/516] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:05 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:05.913619 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6dfcb299-8437-476e-92d6-942e8435dc54 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:05.923381 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6dfcb299-8437-476e-92d6-942e8435dc54 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1760 microversion: 2.1 time: 0.499834 Nov 24 03:07:05.954637 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 248/517] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:05 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1760 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:06.092608 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1c82f044-4937-4111-8e99-27bae9c79c1c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:06.093968 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1c82f044-4937-4111-8e99-27bae9c79c1c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:06.107814 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1c82f044-4937-4111-8e99-27bae9c79c1c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:06.110748 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1c82f044-4937-4111-8e99-27bae9c79c1c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:06.111640 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1c82f044-4937-4111-8e99-27bae9c79c1c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:06.114826 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1c82f044-4937-4111-8e99-27bae9c79c1c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:06.220170 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-8469a787-350d-4835-8f2a-a8f75df1aa98 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] Action: 'create', calling method: .version_select at 0x7f7a2ea543a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-983204886", "metadata": {"Type": "work"}}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:07:06.222002 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-8469a787-350d-4835-8f2a-a8f75df1aa98 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:07:06.223587 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-8469a787-350d-4835-8f2a-a8f75df1aa98 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.231389 Nov 24 03:07:06.225110 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 270/518] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Nov 24 03:07:05 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 234 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 24 03:07:06.236698 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5e2322f0-d82e-43d5-a0af-e74d1380aa42 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] Action: 'create', calling method: .version_select at 0x7f7a2ded1040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-450279944", "metadata": {"Type": "work"}}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:07:06.238216 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5e2322f0-d82e-43d5-a0af-e74d1380aa42 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:07:06.239508 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-5e2322f0-d82e-43d5-a0af-e74d1380aa42 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007452 Nov 24 03:07:06.241077 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 271/519] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Nov 24 03:07:06 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 24 03:07:06.251022 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c31ca69f-a718-45e7-8047-45f18cbc67a9 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] Action: 'create', calling method: .version_select at 0x7f7a2e0f14c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1960337330", "metadata": {"Type": "work"}}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:07:06.252939 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c31ca69f-a718-45e7-8047-45f18cbc67a9 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:07:06.253964 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c31ca69f-a718-45e7-8047-45f18cbc67a9 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008054 Nov 24 03:07:06.255064 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 272/520] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Nov 24 03:07:06 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 24 03:07:06.265083 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-dfbcdcd3-69ef-476a-9b02-bc89d8348e96 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] Calling method '.version_select at 0x7f7a2ded1b80>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:06.312640 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-dfbcdcd3-69ef-476a-9b02-bc89d8348e96 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] HTTP exception thrown: Volume tempest-invalid-1728223759 could not be found. Nov 24 03:07:06.313819 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-dfbcdcd3-69ef-476a-9b02-bc89d8348e96 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] Returning 404 to user: Volume tempest-invalid-1728223759 could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:07:06.315485 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-dfbcdcd3-69ef-476a-9b02-bc89d8348e96 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1728223759" status: 404 len: 99 microversion: 2.1 time: 0.054318 Nov 24 03:07:06.316684 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 273/521] 10.222.0.52 () {58 vars in 1217 bytes} [Wed Nov 24 03:07:06 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1728223759 => generated 99 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 24 03:07:06.338737 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-1d33980a-23e7-4b72-bd80-b46b1fac9f1b tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013837 Nov 24 03:07:06.339607 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 274/522] 10.222.0.52 () {58 vars in 1139 bytes} [Wed Nov 24 03:07:06 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 24 03:07:06.352766 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-bd9b851b-fd7b-4e31-acb9-555001ed1a66 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004699 Nov 24 03:07:06.353711 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 275/523] 10.222.0.52 () {58 vars in 1136 bytes} [Wed Nov 24 03:07:06 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 24 03:07:06.363702 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-eff571de-91de-4c28-a7c7-786c8f67f976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:06.365840 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-eff571de-91de-4c28-a7c7-786c8f67f976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:06.380498 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-eff571de-91de-4c28-a7c7-786c8f67f976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:06.380498 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-eff571de-91de-4c28-a7c7-786c8f67f976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:06.380498 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-eff571de-91de-4c28-a7c7-786c8f67f976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:06.380498 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-eff571de-91de-4c28-a7c7-786c8f67f976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:06.425683 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1c82f044-4937-4111-8e99-27bae9c79c1c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:06.450536 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1c82f044-4937-4111-8e99-27bae9c79c1c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1724 microversion: 2.1 time: 0.362922 Nov 24 03:07:06.453720 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 249/524] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:06 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:07:06.465408 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bcae0be6-c0ab-4962-8cc3-f143aead4be7 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] Calling method '.version_select at 0x7f7a2df523a0>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:06.547540 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-bcae0be6-c0ab-4962-8cc3-f143aead4be7 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] HTTP exception thrown: Volume 074b3198-12e1-4267-9305-b4b23b1adf2d could not be found. Nov 24 03:07:06.549721 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bcae0be6-c0ab-4962-8cc3-f143aead4be7 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] Returning 404 to user: Volume 074b3198-12e1-4267-9305-b4b23b1adf2d could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:07:06.552655 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bcae0be6-c0ab-4962-8cc3-f143aead4be7 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/074b3198-12e1-4267-9305-b4b23b1adf2d" status: 404 len: 109 microversion: 2.1 time: 0.095922 Nov 24 03:07:06.554070 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 250/525] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Nov 24 03:07:06 2021] DELETE /compute/v2.1/os-volumes/074b3198-12e1-4267-9305-b4b23b1adf2d => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:07:06.566526 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d9d298da-d7d1-4986-afb3-51b820ec0c79 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] Calling method '.version_select at 0x7f7a2df2e280>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:06.622054 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-d9d298da-d7d1-4986-afb3-51b820ec0c79 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] HTTP exception thrown: Volume 6669c46e-6987-4c3e-9933-691235e0dac3 could not be found. Nov 24 03:07:06.623161 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d9d298da-d7d1-4986-afb3-51b820ec0c79 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] Returning 404 to user: Volume 6669c46e-6987-4c3e-9933-691235e0dac3 could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:07:06.624693 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d9d298da-d7d1-4986-afb3-51b820ec0c79 tempest-VolumesNegativeTest-621960823 tempest-VolumesNegativeTest-621960823-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6669c46e-6987-4c3e-9933-691235e0dac3" status: 404 len: 109 microversion: 2.1 time: 0.061149 Nov 24 03:07:06.625421 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 251/526] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Nov 24 03:07:06 2021] GET /compute/v2.1/os-volumes/6669c46e-6987-4c3e-9933-691235e0dac3 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:07:06.673959 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-eff571de-91de-4c28-a7c7-786c8f67f976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:06.687087 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-eff571de-91de-4c28-a7c7-786c8f67f976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:06.692055 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-eff571de-91de-4c28-a7c7-786c8f67f976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:06.693267 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-eff571de-91de-4c28-a7c7-786c8f67f976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1751 microversion: 2.20 time: 0.338196 Nov 24 03:07:06.694892 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 276/527] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:06 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1751 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:06.929747 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c2ebbda7-8f4b-4bf0-acc7-2ec62d8732f6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:06.930403 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c2ebbda7-8f4b-4bf0-acc7-2ec62d8732f6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:06.937316 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2ebbda7-8f4b-4bf0-acc7-2ec62d8732f6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:06.938183 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2ebbda7-8f4b-4bf0-acc7-2ec62d8732f6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:06.939223 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2ebbda7-8f4b-4bf0-acc7-2ec62d8732f6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:06.940522 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2ebbda7-8f4b-4bf0-acc7-2ec62d8732f6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:07.129444 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c2ebbda7-8f4b-4bf0-acc7-2ec62d8732f6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:07.139886 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c2ebbda7-8f4b-4bf0-acc7-2ec62d8732f6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.214603 Nov 24 03:07:07.143210 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 252/528] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:06 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:07.470381 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c424c931-f742-46b2-8559-7f6e24ad569a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:07.470990 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c424c931-f742-46b2-8559-7f6e24ad569a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:07.477253 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c424c931-f742-46b2-8559-7f6e24ad569a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:07.478185 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c424c931-f742-46b2-8559-7f6e24ad569a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:07.479161 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c424c931-f742-46b2-8559-7f6e24ad569a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:07.479596 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c424c931-f742-46b2-8559-7f6e24ad569a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:07.655752 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c424c931-f742-46b2-8559-7f6e24ad569a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:07.670777 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c424c931-f742-46b2-8559-7f6e24ad569a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1724 microversion: 2.1 time: 0.203932 Nov 24 03:07:07.671395 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 277/529] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:07 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:07.726649 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fbd139ec-11c6-4b33-88b0-cbb670bbd9c0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:07.727376 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fbd139ec-11c6-4b33-88b0-cbb670bbd9c0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:07.735463 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fbd139ec-11c6-4b33-88b0-cbb670bbd9c0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:07.736286 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fbd139ec-11c6-4b33-88b0-cbb670bbd9c0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:07.737331 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fbd139ec-11c6-4b33-88b0-cbb670bbd9c0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:07.738002 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fbd139ec-11c6-4b33-88b0-cbb670bbd9c0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:07.940933 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-fbd139ec-11c6-4b33-88b0-cbb670bbd9c0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:07.954882 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-fbd139ec-11c6-4b33-88b0-cbb670bbd9c0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:07.957119 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-fbd139ec-11c6-4b33-88b0-cbb670bbd9c0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:07.958997 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fbd139ec-11c6-4b33-88b0-cbb670bbd9c0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1753 microversion: 2.20 time: 0.235764 Nov 24 03:07:07.959585 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 253/530] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:07 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1753 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:07:08.159816 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-15d94a7d-a8d7-44d0-9977-c5e1c79dad52 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:08.160407 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-15d94a7d-a8d7-44d0-9977-c5e1c79dad52 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:08.167795 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-15d94a7d-a8d7-44d0-9977-c5e1c79dad52 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:08.168466 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-15d94a7d-a8d7-44d0-9977-c5e1c79dad52 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:08.169523 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-15d94a7d-a8d7-44d0-9977-c5e1c79dad52 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:08.169948 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-15d94a7d-a8d7-44d0-9977-c5e1c79dad52 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:08.325939 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-15d94a7d-a8d7-44d0-9977-c5e1c79dad52 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:08.335536 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-15d94a7d-a8d7-44d0-9977-c5e1c79dad52 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.180147 Nov 24 03:07:08.336148 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 278/531] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:08 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:08.696753 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-dbb3919d-4e7c-4337-b18e-83d934b458b2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:08.697809 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-dbb3919d-4e7c-4337-b18e-83d934b458b2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:08.705366 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dbb3919d-4e7c-4337-b18e-83d934b458b2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:08.706073 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dbb3919d-4e7c-4337-b18e-83d934b458b2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:08.706957 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dbb3919d-4e7c-4337-b18e-83d934b458b2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:08.707542 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dbb3919d-4e7c-4337-b18e-83d934b458b2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:08.938050 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-dbb3919d-4e7c-4337-b18e-83d934b458b2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:08.966255 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-dbb3919d-4e7c-4337-b18e-83d934b458b2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1724 microversion: 2.1 time: 0.265945 Nov 24 03:07:08.978074 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 254/532] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:08 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:08.987470 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-87a63578-d2f7-423b-9634-47f507c60c9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:08.988598 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-87a63578-d2f7-423b-9634-47f507c60c9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:09.001195 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-87a63578-d2f7-423b-9634-47f507c60c9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:09.006142 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-87a63578-d2f7-423b-9634-47f507c60c9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:09.007195 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-87a63578-d2f7-423b-9634-47f507c60c9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:09.009075 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-87a63578-d2f7-423b-9634-47f507c60c9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:09.341497 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-87a63578-d2f7-423b-9634-47f507c60c9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:09.354902 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d698cbd7-bb25-4917-a257-a9f6002598ec tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:09.355894 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d698cbd7-bb25-4917-a257-a9f6002598ec tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:09.364359 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-87a63578-d2f7-423b-9634-47f507c60c9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:09.366143 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-87a63578-d2f7-423b-9634-47f507c60c9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:09.367402 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-87a63578-d2f7-423b-9634-47f507c60c9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.384444 Nov 24 03:07:09.367837 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d698cbd7-bb25-4917-a257-a9f6002598ec tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:09.367988 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 279/533] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:08 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:09.378134 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d698cbd7-bb25-4917-a257-a9f6002598ec tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:09.378134 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d698cbd7-bb25-4917-a257-a9f6002598ec tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:09.378134 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d698cbd7-bb25-4917-a257-a9f6002598ec tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:09.565756 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d698cbd7-bb25-4917-a257-a9f6002598ec tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:09.575111 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d698cbd7-bb25-4917-a257-a9f6002598ec tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.226065 Nov 24 03:07:09.575798 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 255/534] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:09 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:09.984448 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-627bb8a4-cbe3-4b87-bc4c-9e6bb881fdd6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:09.985458 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-627bb8a4-cbe3-4b87-bc4c-9e6bb881fdd6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:09.992755 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-627bb8a4-cbe3-4b87-bc4c-9e6bb881fdd6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:09.993672 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-627bb8a4-cbe3-4b87-bc4c-9e6bb881fdd6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:09.999994 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-627bb8a4-cbe3-4b87-bc4c-9e6bb881fdd6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:10.000883 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-627bb8a4-cbe3-4b87-bc4c-9e6bb881fdd6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:10.314923 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-627bb8a4-cbe3-4b87-bc4c-9e6bb881fdd6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:10.327583 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-627bb8a4-cbe3-4b87-bc4c-9e6bb881fdd6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1724 microversion: 2.1 time: 0.346735 Nov 24 03:07:10.329032 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 280/535] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:09 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:10.387653 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2e777c32-a69b-4268-b7fa-a7f457f51395 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:10.388654 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2e777c32-a69b-4268-b7fa-a7f457f51395 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:10.402045 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2e777c32-a69b-4268-b7fa-a7f457f51395 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:10.403165 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2e777c32-a69b-4268-b7fa-a7f457f51395 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:10.406791 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2e777c32-a69b-4268-b7fa-a7f457f51395 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:10.407970 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2e777c32-a69b-4268-b7fa-a7f457f51395 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:10.602326 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0a89b3f1-9a2b-4067-b997-cae648895ed0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:10.604652 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0a89b3f1-9a2b-4067-b997-cae648895ed0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:10.606262 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2e777c32-a69b-4268-b7fa-a7f457f51395 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:10.617518 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a89b3f1-9a2b-4067-b997-cae648895ed0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:10.618296 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a89b3f1-9a2b-4067-b997-cae648895ed0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:10.619892 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a89b3f1-9a2b-4067-b997-cae648895ed0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:10.620640 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a89b3f1-9a2b-4067-b997-cae648895ed0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:10.631033 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2e777c32-a69b-4268-b7fa-a7f457f51395 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:10.636156 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2e777c32-a69b-4268-b7fa-a7f457f51395 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:10.638009 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2e777c32-a69b-4268-b7fa-a7f457f51395 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.254625 Nov 24 03:07:10.639242 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 256/536] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:10 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:10.912604 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0a89b3f1-9a2b-4067-b997-cae648895ed0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:10.929705 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0a89b3f1-9a2b-4067-b997-cae648895ed0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.331536 Nov 24 03:07:10.930651 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 281/537] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:10 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:11.345205 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-469f601d-6aa5-4157-bc64-8b62237a909e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:11.345830 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-469f601d-6aa5-4157-bc64-8b62237a909e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:11.354465 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-469f601d-6aa5-4157-bc64-8b62237a909e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:11.356696 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-469f601d-6aa5-4157-bc64-8b62237a909e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:11.360454 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-469f601d-6aa5-4157-bc64-8b62237a909e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:11.363167 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-469f601d-6aa5-4157-bc64-8b62237a909e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:11.611843 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-469f601d-6aa5-4157-bc64-8b62237a909e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:11.620065 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-469f601d-6aa5-4157-bc64-8b62237a909e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1724 microversion: 2.1 time: 0.279144 Nov 24 03:07:11.620668 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 257/538] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:11 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:11.658670 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-a6404cd8-783b-4153-85fa-926b1b8f9281 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:11.659305 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-a6404cd8-783b-4153-85fa-926b1b8f9281 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:11.666295 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a6404cd8-783b-4153-85fa-926b1b8f9281 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:11.667009 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a6404cd8-783b-4153-85fa-926b1b8f9281 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:11.667907 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a6404cd8-783b-4153-85fa-926b1b8f9281 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:11.668440 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a6404cd8-783b-4153-85fa-926b1b8f9281 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:11.894298 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-a6404cd8-783b-4153-85fa-926b1b8f9281 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:11.907803 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-a6404cd8-783b-4153-85fa-926b1b8f9281 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:11.910727 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-a6404cd8-783b-4153-85fa-926b1b8f9281 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:11.913262 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-a6404cd8-783b-4153-85fa-926b1b8f9281 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.258844 Nov 24 03:07:11.914565 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 282/539] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:11 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:11.948274 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-58ea2194-265e-4c17-9692-c4c537fc9d9c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:11.949102 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-58ea2194-265e-4c17-9692-c4c537fc9d9c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:11.957071 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58ea2194-265e-4c17-9692-c4c537fc9d9c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:11.957995 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58ea2194-265e-4c17-9692-c4c537fc9d9c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:11.959124 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58ea2194-265e-4c17-9692-c4c537fc9d9c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:11.959794 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58ea2194-265e-4c17-9692-c4c537fc9d9c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:12.131512 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-58ea2194-265e-4c17-9692-c4c537fc9d9c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:12.148660 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-58ea2194-265e-4c17-9692-c4c537fc9d9c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.204279 Nov 24 03:07:12.149280 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 258/540] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:11 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:12.638889 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5d2f92eb-1498-4c7a-b6a7-4c4ea839047d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:12.639630 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-5d2f92eb-1498-4c7a-b6a7-4c4ea839047d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:12.646776 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5d2f92eb-1498-4c7a-b6a7-4c4ea839047d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:12.647235 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5d2f92eb-1498-4c7a-b6a7-4c4ea839047d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:12.648214 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5d2f92eb-1498-4c7a-b6a7-4c4ea839047d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:12.648477 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5d2f92eb-1498-4c7a-b6a7-4c4ea839047d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:12.803601 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5d2f92eb-1498-4c7a-b6a7-4c4ea839047d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:12.825186 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-5d2f92eb-1498-4c7a-b6a7-4c4ea839047d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1724 microversion: 2.1 time: 0.189855 Nov 24 03:07:12.832297 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 283/541] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:12 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:12.943268 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0d735d1a-0843-491a-a3f0-b0eb4efa3cd8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:12.944325 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0d735d1a-0843-491a-a3f0-b0eb4efa3cd8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:12.955999 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d735d1a-0843-491a-a3f0-b0eb4efa3cd8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:12.957117 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d735d1a-0843-491a-a3f0-b0eb4efa3cd8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:12.958517 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d735d1a-0843-491a-a3f0-b0eb4efa3cd8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:12.959297 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d735d1a-0843-491a-a3f0-b0eb4efa3cd8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:13.143949 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0d735d1a-0843-491a-a3f0-b0eb4efa3cd8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:13.153652 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0d735d1a-0843-491a-a3f0-b0eb4efa3cd8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:13.155683 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0d735d1a-0843-491a-a3f0-b0eb4efa3cd8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:13.157034 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0d735d1a-0843-491a-a3f0-b0eb4efa3cd8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.221116 Nov 24 03:07:13.157616 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 259/542] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:12 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:13.171046 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4d981218-7816-4877-b39b-40daa0b392d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:13.171835 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4d981218-7816-4877-b39b-40daa0b392d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:13.177834 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4d981218-7816-4877-b39b-40daa0b392d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:13.178389 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4d981218-7816-4877-b39b-40daa0b392d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:13.179230 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4d981218-7816-4877-b39b-40daa0b392d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:13.179726 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4d981218-7816-4877-b39b-40daa0b392d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:13.352913 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4d981218-7816-4877-b39b-40daa0b392d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:13.362024 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4d981218-7816-4877-b39b-40daa0b392d6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.194725 Nov 24 03:07:13.362604 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 284/543] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:13 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:13.843808 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-102a1a66-9a59-4ec1-b12d-2f225ea5030f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:13.844406 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-102a1a66-9a59-4ec1-b12d-2f225ea5030f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:13.853060 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-102a1a66-9a59-4ec1-b12d-2f225ea5030f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:13.853777 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-102a1a66-9a59-4ec1-b12d-2f225ea5030f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:13.854907 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-102a1a66-9a59-4ec1-b12d-2f225ea5030f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:13.855549 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-102a1a66-9a59-4ec1-b12d-2f225ea5030f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:14.019315 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-102a1a66-9a59-4ec1-b12d-2f225ea5030f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:14.027623 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-102a1a66-9a59-4ec1-b12d-2f225ea5030f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1724 microversion: 2.1 time: 0.187724 Nov 24 03:07:14.028215 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 260/544] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:13 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:14.175837 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e67b0def-3227-4198-a10c-fd34515bc980 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:14.177287 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e67b0def-3227-4198-a10c-fd34515bc980 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:14.183766 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e67b0def-3227-4198-a10c-fd34515bc980 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:14.184534 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e67b0def-3227-4198-a10c-fd34515bc980 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:14.185540 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e67b0def-3227-4198-a10c-fd34515bc980 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:14.185994 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e67b0def-3227-4198-a10c-fd34515bc980 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:14.349944 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e67b0def-3227-4198-a10c-fd34515bc980 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:14.359464 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e67b0def-3227-4198-a10c-fd34515bc980 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:14.360311 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e67b0def-3227-4198-a10c-fd34515bc980 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:14.361498 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e67b0def-3227-4198-a10c-fd34515bc980 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.189705 Nov 24 03:07:14.362094 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 285/545] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:14 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:14.386223 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3e2b6969-eb54-4205-85ed-87010bcb6e7c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:14.387203 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3e2b6969-eb54-4205-85ed-87010bcb6e7c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:14.400358 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3e2b6969-eb54-4205-85ed-87010bcb6e7c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:14.400813 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3e2b6969-eb54-4205-85ed-87010bcb6e7c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:14.401615 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3e2b6969-eb54-4205-85ed-87010bcb6e7c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:14.402090 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3e2b6969-eb54-4205-85ed-87010bcb6e7c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:14.605039 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3e2b6969-eb54-4205-85ed-87010bcb6e7c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:14.618901 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3e2b6969-eb54-4205-85ed-87010bcb6e7c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.236305 Nov 24 03:07:14.619716 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 261/546] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:14 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:15.050522 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0a2660a7-2d25-4354-830b-eb11fd34dd52 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:15.053940 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0a2660a7-2d25-4354-830b-eb11fd34dd52 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:15.057882 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a2660a7-2d25-4354-830b-eb11fd34dd52 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:15.058435 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a2660a7-2d25-4354-830b-eb11fd34dd52 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:15.059224 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a2660a7-2d25-4354-830b-eb11fd34dd52 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:15.059650 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a2660a7-2d25-4354-830b-eb11fd34dd52 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:15.203510 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0a2660a7-2d25-4354-830b-eb11fd34dd52 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:15.212458 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0a2660a7-2d25-4354-830b-eb11fd34dd52 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1724 microversion: 2.1 time: 0.168308 Nov 24 03:07:15.213041 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 286/547] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:15 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:15.383063 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9a1c8133-4c6c-4d58-8550-4ab9314a39b5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:15.383766 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9a1c8133-4c6c-4d58-8550-4ab9314a39b5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:15.393019 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9a1c8133-4c6c-4d58-8550-4ab9314a39b5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:15.393634 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9a1c8133-4c6c-4d58-8550-4ab9314a39b5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:15.394545 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9a1c8133-4c6c-4d58-8550-4ab9314a39b5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:15.395054 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9a1c8133-4c6c-4d58-8550-4ab9314a39b5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:15.556270 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9a1c8133-4c6c-4d58-8550-4ab9314a39b5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:15.566632 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9a1c8133-4c6c-4d58-8550-4ab9314a39b5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:15.569334 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9a1c8133-4c6c-4d58-8550-4ab9314a39b5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:15.570873 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9a1c8133-4c6c-4d58-8550-4ab9314a39b5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.193517 Nov 24 03:07:15.571950 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 262/548] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:15 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:15.637939 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-14d9ee30-1f17-426a-9276-673f5842c251 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:15.638577 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-14d9ee30-1f17-426a-9276-673f5842c251 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:15.648113 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-14d9ee30-1f17-426a-9276-673f5842c251 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:15.648561 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-14d9ee30-1f17-426a-9276-673f5842c251 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:15.649369 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-14d9ee30-1f17-426a-9276-673f5842c251 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:15.649791 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-14d9ee30-1f17-426a-9276-673f5842c251 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:15.804595 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-14d9ee30-1f17-426a-9276-673f5842c251 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:15.815945 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-14d9ee30-1f17-426a-9276-673f5842c251 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.181479 Nov 24 03:07:15.816642 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 287/549] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:15 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:16.229949 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c75c7071-5362-46af-8776-5a4d053e74e4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:16.230567 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c75c7071-5362-46af-8776-5a4d053e74e4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:16.237382 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c75c7071-5362-46af-8776-5a4d053e74e4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:16.237838 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c75c7071-5362-46af-8776-5a4d053e74e4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:16.238648 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c75c7071-5362-46af-8776-5a4d053e74e4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:16.239081 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c75c7071-5362-46af-8776-5a4d053e74e4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:16.378597 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c75c7071-5362-46af-8776-5a4d053e74e4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:16.386455 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c75c7071-5362-46af-8776-5a4d053e74e4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1724 microversion: 2.1 time: 0.160287 Nov 24 03:07:16.387082 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 263/550] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:16 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:16.590053 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-617698a8-b05e-4644-a78a-69c8d8f0f2a3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:16.591006 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-617698a8-b05e-4644-a78a-69c8d8f0f2a3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:16.598199 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-617698a8-b05e-4644-a78a-69c8d8f0f2a3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:16.598643 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-617698a8-b05e-4644-a78a-69c8d8f0f2a3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:16.599445 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-617698a8-b05e-4644-a78a-69c8d8f0f2a3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:16.599869 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-617698a8-b05e-4644-a78a-69c8d8f0f2a3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:16.760439 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-617698a8-b05e-4644-a78a-69c8d8f0f2a3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:16.771811 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-617698a8-b05e-4644-a78a-69c8d8f0f2a3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:16.773349 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-617698a8-b05e-4644-a78a-69c8d8f0f2a3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:16.774897 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-617698a8-b05e-4644-a78a-69c8d8f0f2a3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.188757 Nov 24 03:07:16.787089 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 288/551] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:16 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:16.833397 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-268ec1b0-c098-4ce4-81cc-c42c2da649ab tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:16.834040 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-268ec1b0-c098-4ce4-81cc-c42c2da649ab tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:16.843220 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-268ec1b0-c098-4ce4-81cc-c42c2da649ab tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:16.843713 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-268ec1b0-c098-4ce4-81cc-c42c2da649ab tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:16.844584 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-268ec1b0-c098-4ce4-81cc-c42c2da649ab tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:16.845024 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-268ec1b0-c098-4ce4-81cc-c42c2da649ab tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:17.038026 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-268ec1b0-c098-4ce4-81cc-c42c2da649ab tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:17.051742 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-268ec1b0-c098-4ce4-81cc-c42c2da649ab tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.220897 Nov 24 03:07:17.053760 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 264/552] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:16 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:17.405274 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-44eccdc0-8d14-4ab9-8a0f-9c71824870d4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:17.406465 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-44eccdc0-8d14-4ab9-8a0f-9c71824870d4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:17.414654 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-44eccdc0-8d14-4ab9-8a0f-9c71824870d4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:17.415438 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-44eccdc0-8d14-4ab9-8a0f-9c71824870d4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:17.416483 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-44eccdc0-8d14-4ab9-8a0f-9c71824870d4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:17.417079 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-44eccdc0-8d14-4ab9-8a0f-9c71824870d4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:17.601492 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-44eccdc0-8d14-4ab9-8a0f-9c71824870d4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:17.609531 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-44eccdc0-8d14-4ab9-8a0f-9c71824870d4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1724 microversion: 2.1 time: 0.209370 Nov 24 03:07:17.610154 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 289/553] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:17 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:17.794231 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0e42e374-5861-4d7f-8874-926d55ca948a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:17.794877 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0e42e374-5861-4d7f-8874-926d55ca948a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:17.801463 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0e42e374-5861-4d7f-8874-926d55ca948a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:17.802289 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0e42e374-5861-4d7f-8874-926d55ca948a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:17.803293 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0e42e374-5861-4d7f-8874-926d55ca948a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:17.803927 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0e42e374-5861-4d7f-8874-926d55ca948a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:17.965557 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0e42e374-5861-4d7f-8874-926d55ca948a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:17.974976 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0e42e374-5861-4d7f-8874-926d55ca948a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:17.976447 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0e42e374-5861-4d7f-8874-926d55ca948a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:17.977636 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0e42e374-5861-4d7f-8874-926d55ca948a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.187299 Nov 24 03:07:17.978208 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 265/554] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:17 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:18.070083 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-75bcf0fc-ede0-46ec-b749-990de253ee26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:18.071015 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-75bcf0fc-ede0-46ec-b749-990de253ee26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:18.078694 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-75bcf0fc-ede0-46ec-b749-990de253ee26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:18.079668 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-75bcf0fc-ede0-46ec-b749-990de253ee26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:18.080660 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-75bcf0fc-ede0-46ec-b749-990de253ee26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:18.081260 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-75bcf0fc-ede0-46ec-b749-990de253ee26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:18.265209 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-75bcf0fc-ede0-46ec-b749-990de253ee26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:18.282224 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-75bcf0fc-ede0-46ec-b749-990de253ee26 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.215624 Nov 24 03:07:18.288340 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 290/555] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:18 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:18.627996 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ff801f6a-d924-49d9-91e5-7296816f36a3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:18.629076 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ff801f6a-d924-49d9-91e5-7296816f36a3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:18.641705 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff801f6a-d924-49d9-91e5-7296816f36a3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:18.643627 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff801f6a-d924-49d9-91e5-7296816f36a3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:18.647052 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff801f6a-d924-49d9-91e5-7296816f36a3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:18.648327 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff801f6a-d924-49d9-91e5-7296816f36a3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:18.795171 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ff801f6a-d924-49d9-91e5-7296816f36a3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:18.804144 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ff801f6a-d924-49d9-91e5-7296816f36a3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1724 microversion: 2.1 time: 0.180905 Nov 24 03:07:18.804720 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 266/556] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:18 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:18.998361 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-28f9335a-f46b-4a7c-850a-3cfdc66ddacd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:18.999097 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-28f9335a-f46b-4a7c-850a-3cfdc66ddacd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:19.005855 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-28f9335a-f46b-4a7c-850a-3cfdc66ddacd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:19.006336 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-28f9335a-f46b-4a7c-850a-3cfdc66ddacd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:19.007093 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-28f9335a-f46b-4a7c-850a-3cfdc66ddacd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:19.007529 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-28f9335a-f46b-4a7c-850a-3cfdc66ddacd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:19.150682 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-28f9335a-f46b-4a7c-850a-3cfdc66ddacd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:19.160332 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-28f9335a-f46b-4a7c-850a-3cfdc66ddacd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:19.161834 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-28f9335a-f46b-4a7c-850a-3cfdc66ddacd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:19.163041 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-28f9335a-f46b-4a7c-850a-3cfdc66ddacd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.169739 Nov 24 03:07:19.163614 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 291/557] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:18 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:19.301124 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d8be37f8-e154-4c10-b294-80407bbc899c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:19.301641 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d8be37f8-e154-4c10-b294-80407bbc899c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:19.308293 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d8be37f8-e154-4c10-b294-80407bbc899c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:19.308748 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d8be37f8-e154-4c10-b294-80407bbc899c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:19.309550 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d8be37f8-e154-4c10-b294-80407bbc899c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:19.310025 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d8be37f8-e154-4c10-b294-80407bbc899c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:19.492017 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d8be37f8-e154-4c10-b294-80407bbc899c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:19.501138 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d8be37f8-e154-4c10-b294-80407bbc899c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.203792 Nov 24 03:07:19.501744 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 267/558] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:19 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:19.822795 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-8183da64-f258-493b-80e8-1154d2c3c333 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:19.824016 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-8183da64-f258-493b-80e8-1154d2c3c333 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:19.832742 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8183da64-f258-493b-80e8-1154d2c3c333 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:19.833395 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8183da64-f258-493b-80e8-1154d2c3c333 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:19.834600 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8183da64-f258-493b-80e8-1154d2c3c333 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:19.835249 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8183da64-f258-493b-80e8-1154d2c3c333 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:20.016579 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-8183da64-f258-493b-80e8-1154d2c3c333 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:20.027136 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-8183da64-f258-493b-80e8-1154d2c3c333 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1724 microversion: 2.1 time: 0.209120 Nov 24 03:07:20.037533 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 292/559] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:19 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:20.185650 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e46ef496-b378-40f2-a417-7a15076f2652 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:20.186507 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e46ef496-b378-40f2-a417-7a15076f2652 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:20.194791 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e46ef496-b378-40f2-a417-7a15076f2652 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:20.195220 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e46ef496-b378-40f2-a417-7a15076f2652 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:20.196024 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e46ef496-b378-40f2-a417-7a15076f2652 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:20.196490 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e46ef496-b378-40f2-a417-7a15076f2652 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:20.373150 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e46ef496-b378-40f2-a417-7a15076f2652 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:20.393296 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e46ef496-b378-40f2-a417-7a15076f2652 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:20.396389 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e46ef496-b378-40f2-a417-7a15076f2652 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:20.398697 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e46ef496-b378-40f2-a417-7a15076f2652 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.217708 Nov 24 03:07:20.401974 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 268/560] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:20 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:20.521876 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-a40ab346-0597-424c-a176-f83747644752 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:20.522519 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-a40ab346-0597-424c-a176-f83747644752 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:20.529376 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a40ab346-0597-424c-a176-f83747644752 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:20.530311 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a40ab346-0597-424c-a176-f83747644752 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:20.531524 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a40ab346-0597-424c-a176-f83747644752 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:20.531972 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a40ab346-0597-424c-a176-f83747644752 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:20.702661 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-a40ab346-0597-424c-a176-f83747644752 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:20.714653 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-a40ab346-0597-424c-a176-f83747644752 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.194832 Nov 24 03:07:20.714653 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 293/561] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:20 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:07:21.044430 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6e3ade78-306e-467a-b693-e753e5bbbf04 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:21.045053 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6e3ade78-306e-467a-b693-e753e5bbbf04 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:21.051096 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6e3ade78-306e-467a-b693-e753e5bbbf04 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:21.051549 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6e3ade78-306e-467a-b693-e753e5bbbf04 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:21.052338 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6e3ade78-306e-467a-b693-e753e5bbbf04 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:21.052869 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6e3ade78-306e-467a-b693-e753e5bbbf04 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:21.210239 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6e3ade78-306e-467a-b693-e753e5bbbf04 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:21.221661 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6e3ade78-306e-467a-b693-e753e5bbbf04 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1724 microversion: 2.1 time: 0.180850 Nov 24 03:07:21.222988 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 269/562] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:21 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:21.419078 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-fb8d9dfa-11c9-4ee0-8460-ce2226aa686a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:21.419717 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-fb8d9dfa-11c9-4ee0-8460-ce2226aa686a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:21.426654 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fb8d9dfa-11c9-4ee0-8460-ce2226aa686a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:21.427110 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fb8d9dfa-11c9-4ee0-8460-ce2226aa686a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:21.427920 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fb8d9dfa-11c9-4ee0-8460-ce2226aa686a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:21.428405 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fb8d9dfa-11c9-4ee0-8460-ce2226aa686a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:21.575609 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-fb8d9dfa-11c9-4ee0-8460-ce2226aa686a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:21.585103 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-fb8d9dfa-11c9-4ee0-8460-ce2226aa686a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:21.586717 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-fb8d9dfa-11c9-4ee0-8460-ce2226aa686a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:21.587898 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-fb8d9dfa-11c9-4ee0-8460-ce2226aa686a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.172675 Nov 24 03:07:21.588499 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 294/563] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:21 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:21.731381 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b7f6b387-95a9-49aa-bf5e-cfe412ea4214 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:21.731990 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b7f6b387-95a9-49aa-bf5e-cfe412ea4214 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:21.739083 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b7f6b387-95a9-49aa-bf5e-cfe412ea4214 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:21.739531 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b7f6b387-95a9-49aa-bf5e-cfe412ea4214 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:21.740319 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b7f6b387-95a9-49aa-bf5e-cfe412ea4214 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:21.740852 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b7f6b387-95a9-49aa-bf5e-cfe412ea4214 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:21.876791 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b7f6b387-95a9-49aa-bf5e-cfe412ea4214 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:21.885296 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b7f6b387-95a9-49aa-bf5e-cfe412ea4214 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.157573 Nov 24 03:07:21.885884 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 270/564] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:21 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:22.239611 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-a1d20804-7a09-46bb-a1ad-62e0cf889ece tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:22.240219 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-a1d20804-7a09-46bb-a1ad-62e0cf889ece tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:22.246447 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a1d20804-7a09-46bb-a1ad-62e0cf889ece tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:22.246895 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a1d20804-7a09-46bb-a1ad-62e0cf889ece tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:22.247702 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a1d20804-7a09-46bb-a1ad-62e0cf889ece tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:22.248122 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a1d20804-7a09-46bb-a1ad-62e0cf889ece tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:22.392085 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-a1d20804-7a09-46bb-a1ad-62e0cf889ece tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:22.401253 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-a1d20804-7a09-46bb-a1ad-62e0cf889ece tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1724 microversion: 2.1 time: 0.165206 Nov 24 03:07:22.401951 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 295/565] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:22 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:22.606770 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ceb081de-b5b0-47e5-afef-e8d3a192b56e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:22.607456 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ceb081de-b5b0-47e5-afef-e8d3a192b56e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:22.614551 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ceb081de-b5b0-47e5-afef-e8d3a192b56e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:22.614994 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ceb081de-b5b0-47e5-afef-e8d3a192b56e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:22.615777 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ceb081de-b5b0-47e5-afef-e8d3a192b56e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:22.616214 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ceb081de-b5b0-47e5-afef-e8d3a192b56e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:22.756674 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ceb081de-b5b0-47e5-afef-e8d3a192b56e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:22.766175 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ceb081de-b5b0-47e5-afef-e8d3a192b56e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:22.767870 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ceb081de-b5b0-47e5-afef-e8d3a192b56e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:22.773368 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ceb081de-b5b0-47e5-afef-e8d3a192b56e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.166098 Nov 24 03:07:22.773368 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 271/566] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:22 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:22.904326 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-fe713331-197e-4d17-bf8e-3c8c18eb7f2c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:22.904991 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-fe713331-197e-4d17-bf8e-3c8c18eb7f2c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:22.915028 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fe713331-197e-4d17-bf8e-3c8c18eb7f2c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:22.915826 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fe713331-197e-4d17-bf8e-3c8c18eb7f2c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:22.917175 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fe713331-197e-4d17-bf8e-3c8c18eb7f2c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:22.917963 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fe713331-197e-4d17-bf8e-3c8c18eb7f2c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:23.067868 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-fe713331-197e-4d17-bf8e-3c8c18eb7f2c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:23.078956 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-fe713331-197e-4d17-bf8e-3c8c18eb7f2c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.178289 Nov 24 03:07:23.079581 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 296/567] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:22 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:23.419664 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c386b665-a20c-4255-ac07-9171be3f0584 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:23.420271 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c386b665-a20c-4255-ac07-9171be3f0584 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:23.426876 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c386b665-a20c-4255-ac07-9171be3f0584 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:23.427324 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c386b665-a20c-4255-ac07-9171be3f0584 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:23.428120 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c386b665-a20c-4255-ac07-9171be3f0584 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:23.428552 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c386b665-a20c-4255-ac07-9171be3f0584 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:23.578502 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c386b665-a20c-4255-ac07-9171be3f0584 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:23.587633 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c386b665-a20c-4255-ac07-9171be3f0584 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1724 microversion: 2.1 time: 0.171548 Nov 24 03:07:23.588266 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 272/568] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:23 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:23.796625 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2ad0f558-7404-454e-8ae5-bea443c9a78b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:23.798004 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2ad0f558-7404-454e-8ae5-bea443c9a78b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:23.805836 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ad0f558-7404-454e-8ae5-bea443c9a78b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:23.806322 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ad0f558-7404-454e-8ae5-bea443c9a78b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:23.807096 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ad0f558-7404-454e-8ae5-bea443c9a78b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:23.807585 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ad0f558-7404-454e-8ae5-bea443c9a78b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:23.969827 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2ad0f558-7404-454e-8ae5-bea443c9a78b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:23.979262 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2ad0f558-7404-454e-8ae5-bea443c9a78b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:23.980730 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2ad0f558-7404-454e-8ae5-bea443c9a78b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:23.981906 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2ad0f558-7404-454e-8ae5-bea443c9a78b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.192289 Nov 24 03:07:23.982752 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 297/569] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:23 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:24.101156 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ca707953-e0e2-461d-b611-9008d24add55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:24.101738 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ca707953-e0e2-461d-b611-9008d24add55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:24.109472 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca707953-e0e2-461d-b611-9008d24add55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:24.109959 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca707953-e0e2-461d-b611-9008d24add55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:24.110769 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca707953-e0e2-461d-b611-9008d24add55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:24.111234 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca707953-e0e2-461d-b611-9008d24add55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:24.253948 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ca707953-e0e2-461d-b611-9008d24add55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:24.262381 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ca707953-e0e2-461d-b611-9008d24add55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.165246 Nov 24 03:07:24.263343 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 273/570] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:24 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:24.605338 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-cdfa8699-a5f2-4aaf-82ff-6352dc7e4b58 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:24.606044 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-cdfa8699-a5f2-4aaf-82ff-6352dc7e4b58 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:24.612907 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cdfa8699-a5f2-4aaf-82ff-6352dc7e4b58 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:24.613261 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cdfa8699-a5f2-4aaf-82ff-6352dc7e4b58 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:24.614133 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cdfa8699-a5f2-4aaf-82ff-6352dc7e4b58 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:24.614605 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cdfa8699-a5f2-4aaf-82ff-6352dc7e4b58 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:24.768595 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-cdfa8699-a5f2-4aaf-82ff-6352dc7e4b58 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:24.776609 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-cdfa8699-a5f2-4aaf-82ff-6352dc7e4b58 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1701 microversion: 2.1 time: 0.175023 Nov 24 03:07:24.777168 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 298/571] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:24 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1701 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:24.794229 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-83ca1b2f-1118-4bcd-a2d4-6393442710f9 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:07:24.800738 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-83ca1b2f-1118-4bcd-a2d4-6393442710f9 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:24.801184 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-83ca1b2f-1118-4bcd-a2d4-6393442710f9 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:24.865356 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-83ca1b2f-1118-4bcd-a2d4-6393442710f9 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Going to try to start instance {{(pid=116330) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 24 03:07:24.914234 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-83ca1b2f-1118-4bcd-a2d4-6393442710f9 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 202 len: 0 microversion: 2.1 time: 0.123318 Nov 24 03:07:24.917153 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 274/572] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:07:24 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:07:24.927047 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2ca16678-f642-4339-8fa4-474d055181cd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:24.927774 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2ca16678-f642-4339-8fa4-474d055181cd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:24.935051 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ca16678-f642-4339-8fa4-474d055181cd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:24.935505 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ca16678-f642-4339-8fa4-474d055181cd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:24.936808 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ca16678-f642-4339-8fa4-474d055181cd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:24.937311 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2ca16678-f642-4339-8fa4-474d055181cd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:25.003703 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d8fdfa00-5db6-4e64-b622-d0929aa0b3b4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:25.003703 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d8fdfa00-5db6-4e64-b622-d0929aa0b3b4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:25.012278 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d8fdfa00-5db6-4e64-b622-d0929aa0b3b4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:25.012732 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d8fdfa00-5db6-4e64-b622-d0929aa0b3b4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:25.013527 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d8fdfa00-5db6-4e64-b622-d0929aa0b3b4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:25.013982 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d8fdfa00-5db6-4e64-b622-d0929aa0b3b4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:25.109028 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2ca16678-f642-4339-8fa4-474d055181cd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:25.117416 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2ca16678-f642-4339-8fa4-474d055181cd tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1710 microversion: 2.1 time: 0.194252 Nov 24 03:07:25.117946 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 299/573] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:24 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1710 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:07:25.261389 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d8fdfa00-5db6-4e64-b622-d0929aa0b3b4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:25.280367 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d8fdfa00-5db6-4e64-b622-d0929aa0b3b4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:25.281114 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-649f1d27-40fe-4953-a07b-f8ec36aa36e4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:25.281822 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-649f1d27-40fe-4953-a07b-f8ec36aa36e4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:25.282022 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d8fdfa00-5db6-4e64-b622-d0929aa0b3b4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:25.283292 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d8fdfa00-5db6-4e64-b622-d0929aa0b3b4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.286044 Nov 24 03:07:25.283865 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 275/574] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:24 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:25.289178 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-649f1d27-40fe-4953-a07b-f8ec36aa36e4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:25.289889 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-649f1d27-40fe-4953-a07b-f8ec36aa36e4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:25.291130 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-649f1d27-40fe-4953-a07b-f8ec36aa36e4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:25.291704 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-649f1d27-40fe-4953-a07b-f8ec36aa36e4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:25.455912 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-649f1d27-40fe-4953-a07b-f8ec36aa36e4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:25.464569 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-649f1d27-40fe-4953-a07b-f8ec36aa36e4 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.187652 Nov 24 03:07:25.465155 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 300/575] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:25 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:07:26.054129 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ef311777-0f06-435c-99f9-46cf058c7f23 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1095464037", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1838051711", "security_groups": [{"name": "tempest-secgroup-smoke-1837399852"}], "networks": [{"uuid": "08f13b6e-eecf-471b-a6ac-25fe057c16e1"}], "block_device_mapping_v2": [{"uuid": "0b49593c-9158-44f3-9cd0-8ae65e7cea25", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:07:26.134957 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-3b05a064-90ce-4695-ae4c-88c027f1480a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:26.135720 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-3b05a064-90ce-4695-ae4c-88c027f1480a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:26.143088 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3b05a064-90ce-4695-ae4c-88c027f1480a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:26.143875 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3b05a064-90ce-4695-ae4c-88c027f1480a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:26.145564 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3b05a064-90ce-4695-ae4c-88c027f1480a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:26.146420 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3b05a064-90ce-4695-ae4c-88c027f1480a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:26.194422 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-ef311777-0f06-435c-99f9-46cf058c7f23 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] validate_networks() for [('08f13b6e-eecf-471b-a6ac-25fe057c16e1', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:07:26.299161 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-3b05a064-90ce-4695-ae4c-88c027f1480a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:26.307345 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-3b05a064-90ce-4695-ae4c-88c027f1480a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1710 microversion: 2.1 time: 0.176015 Nov 24 03:07:26.307930 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 301/576] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:26 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1710 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:26.312974 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5743d021-1610-4f21-a591-ea62d8ad4a90 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:26.313797 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-5743d021-1610-4f21-a591-ea62d8ad4a90 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:26.320136 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5743d021-1610-4f21-a591-ea62d8ad4a90 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:26.320586 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5743d021-1610-4f21-a591-ea62d8ad4a90 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:26.321365 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5743d021-1610-4f21-a591-ea62d8ad4a90 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:26.321793 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5743d021-1610-4f21-a591-ea62d8ad4a90 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:26.462826 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5743d021-1610-4f21-a591-ea62d8ad4a90 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:26.472233 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5743d021-1610-4f21-a591-ea62d8ad4a90 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:26.473826 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5743d021-1610-4f21-a591-ea62d8ad4a90 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:26.475109 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-5743d021-1610-4f21-a591-ea62d8ad4a90 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.166103 Nov 24 03:07:26.475751 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 302/577] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:26 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:26.482869 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-44c03dc3-c195-4ba2-b8bb-575c75de3be0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:26.483858 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-44c03dc3-c195-4ba2-b8bb-575c75de3be0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:26.489950 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-44c03dc3-c195-4ba2-b8bb-575c75de3be0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:26.490388 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-44c03dc3-c195-4ba2-b8bb-575c75de3be0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:26.491199 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-44c03dc3-c195-4ba2-b8bb-575c75de3be0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:26.491612 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-44c03dc3-c195-4ba2-b8bb-575c75de3be0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:26.603417 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-ef311777-0f06-435c-99f9-46cf058c7f23 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:07:26.603931 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-ef311777-0f06-435c-99f9-46cf058c7f23 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:07:26.604294 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-ef311777-0f06-435c-99f9-46cf058c7f23 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:07:26.604700 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-ef311777-0f06-435c-99f9-46cf058c7f23 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:07:26.605141 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-ef311777-0f06-435c-99f9-46cf058c7f23 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:07:26.614445 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ef311777-0f06-435c-99f9-46cf058c7f23 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:26.614895 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ef311777-0f06-435c-99f9-46cf058c7f23 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:26.615701 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ef311777-0f06-435c-99f9-46cf058c7f23 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:26.616139 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ef311777-0f06-435c-99f9-46cf058c7f23 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:26.622938 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-44c03dc3-c195-4ba2-b8bb-575c75de3be0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:26.631183 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-44c03dc3-c195-4ba2-b8bb-575c75de3be0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.153263 Nov 24 03:07:26.631760 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 303/578] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:26 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:07:26.632774 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-ef311777-0f06-435c-99f9-46cf058c7f23 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Getting quotas for project 1e5a7594dcfc4cc6b0e9d09a768fd72f. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:07:26.637270 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-ef311777-0f06-435c-99f9-46cf058c7f23 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Getting quotas for user 848fe17e3a994374a7a30d38ed5e3299 and project 1e5a7594dcfc4cc6b0e9d09a768fd72f. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:07:26.703824 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ef311777-0f06-435c-99f9-46cf058c7f23 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:07:26.706036 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ef311777-0f06-435c-99f9-46cf058c7f23 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0b49593c-9158-44f3-9cd0-8ae65e7cea25',volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:07:26.837376 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ef311777-0f06-435c-99f9-46cf058c7f23 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.786937 Nov 24 03:07:26.838008 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 276/579] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Nov 24 03:07:26 2021] POST /compute/v2.1/servers => generated 406 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 03:07:26.848760 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e80c24c0-ec50-479f-aa50-671a7031e8bc tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:26.849534 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e80c24c0-ec50-479f-aa50-671a7031e8bc tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:26.907280 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e80c24c0-ec50-479f-aa50-671a7031e8bc tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:26.914855 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e80c24c0-ec50-479f-aa50-671a7031e8bc tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1089 microversion: 2.1 time: 0.069729 Nov 24 03:07:26.915572 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 304/580] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:26 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:27.327035 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c31c97db-cf38-443d-808c-024fac867cc7 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:27.327686 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c31c97db-cf38-443d-808c-024fac867cc7 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:27.335318 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c31c97db-cf38-443d-808c-024fac867cc7 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:27.335766 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c31c97db-cf38-443d-808c-024fac867cc7 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:27.336551 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c31c97db-cf38-443d-808c-024fac867cc7 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:27.336982 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c31c97db-cf38-443d-808c-024fac867cc7 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:27.476700 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c31c97db-cf38-443d-808c-024fac867cc7 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:27.489520 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c31c97db-cf38-443d-808c-024fac867cc7 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1710 microversion: 2.1 time: 0.168067 Nov 24 03:07:27.490256 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 277/581] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:27 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1710 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:27.494226 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e639b49e-131c-4577-8b82-c47a95deb608 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:27.494829 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e639b49e-131c-4577-8b82-c47a95deb608 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:27.501336 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e639b49e-131c-4577-8b82-c47a95deb608 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:27.501780 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e639b49e-131c-4577-8b82-c47a95deb608 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:27.502600 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e639b49e-131c-4577-8b82-c47a95deb608 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:27.503047 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e639b49e-131c-4577-8b82-c47a95deb608 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:27.647792 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e639b49e-131c-4577-8b82-c47a95deb608 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:27.648794 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-361f0009-f87d-4774-a6bc-26ab19365c62 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:27.649402 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-361f0009-f87d-4774-a6bc-26ab19365c62 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:27.656097 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-361f0009-f87d-4774-a6bc-26ab19365c62 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:27.656545 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-361f0009-f87d-4774-a6bc-26ab19365c62 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:27.657210 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e639b49e-131c-4577-8b82-c47a95deb608 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:27.657336 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-361f0009-f87d-4774-a6bc-26ab19365c62 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:27.657759 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-361f0009-f87d-4774-a6bc-26ab19365c62 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:27.658742 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e639b49e-131c-4577-8b82-c47a95deb608 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:27.659911 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e639b49e-131c-4577-8b82-c47a95deb608 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.169520 Nov 24 03:07:27.660459 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 305/582] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:27 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:07:27.799546 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-361f0009-f87d-4774-a6bc-26ab19365c62 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:27.811458 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-361f0009-f87d-4774-a6bc-26ab19365c62 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.165884 Nov 24 03:07:27.812017 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 278/583] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:27 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:27.933821 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c80ef009-375f-48cb-ba4b-708d4b890d92 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:27.934370 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c80ef009-375f-48cb-ba4b-708d4b890d92 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:27.941357 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c80ef009-375f-48cb-ba4b-708d4b890d92 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:27.941812 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c80ef009-375f-48cb-ba4b-708d4b890d92 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:27.942637 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c80ef009-375f-48cb-ba4b-708d4b890d92 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:27.943066 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c80ef009-375f-48cb-ba4b-708d4b890d92 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:28.004688 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c80ef009-375f-48cb-ba4b-708d4b890d92 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:28.012326 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c80ef009-375f-48cb-ba4b-708d4b890d92 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1139 microversion: 2.1 time: 0.082404 Nov 24 03:07:28.012908 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 306/584] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:27 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:28.508622 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-87c99d3d-a21b-4866-820c-27af15c09352 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:28.509023 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-87c99d3d-a21b-4866-820c-27af15c09352 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:28.515898 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-87c99d3d-a21b-4866-820c-27af15c09352 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:28.516413 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-87c99d3d-a21b-4866-820c-27af15c09352 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:28.517962 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-87c99d3d-a21b-4866-820c-27af15c09352 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:28.518606 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-87c99d3d-a21b-4866-820c-27af15c09352 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:28.686981 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-8609cb25-cb16-4b21-a10e-a411702d3936 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:28.687822 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-8609cb25-cb16-4b21-a10e-a411702d3936 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:28.694780 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8609cb25-cb16-4b21-a10e-a411702d3936 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:28.695557 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8609cb25-cb16-4b21-a10e-a411702d3936 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:28.696711 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8609cb25-cb16-4b21-a10e-a411702d3936 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:28.697243 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8609cb25-cb16-4b21-a10e-a411702d3936 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:28.709507 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-87c99d3d-a21b-4866-820c-27af15c09352 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:28.721445 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-87c99d3d-a21b-4866-820c-27af15c09352 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1710 microversion: 2.1 time: 0.216638 Nov 24 03:07:28.731748 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 279/585] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:28 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1710 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:28.829735 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f5d5a7d0-7951-4159-8ff4-8ecd028ba324 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:28.830400 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f5d5a7d0-7951-4159-8ff4-8ecd028ba324 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:28.837980 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f5d5a7d0-7951-4159-8ff4-8ecd028ba324 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:28.838434 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f5d5a7d0-7951-4159-8ff4-8ecd028ba324 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:28.843486 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f5d5a7d0-7951-4159-8ff4-8ecd028ba324 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:28.845138 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f5d5a7d0-7951-4159-8ff4-8ecd028ba324 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:28.869532 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-8609cb25-cb16-4b21-a10e-a411702d3936 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:28.878879 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-8609cb25-cb16-4b21-a10e-a411702d3936 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:28.880360 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-8609cb25-cb16-4b21-a10e-a411702d3936 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:28.881533 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-8609cb25-cb16-4b21-a10e-a411702d3936 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.198393 Nov 24 03:07:28.882137 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 307/586] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:28 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:29.029230 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-023821f2-ae06-415b-8d8b-e4f3f08458be tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:29.030169 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-023821f2-ae06-415b-8d8b-e4f3f08458be tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:29.037102 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-023821f2-ae06-415b-8d8b-e4f3f08458be tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:29.037572 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-023821f2-ae06-415b-8d8b-e4f3f08458be tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:29.038376 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-023821f2-ae06-415b-8d8b-e4f3f08458be tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:29.038805 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-023821f2-ae06-415b-8d8b-e4f3f08458be tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:29.123754 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-023821f2-ae06-415b-8d8b-e4f3f08458be tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:29.132661 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-023821f2-ae06-415b-8d8b-e4f3f08458be tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1187 microversion: 2.1 time: 0.106866 Nov 24 03:07:29.133722 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 308/587] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:29 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1187 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:29.297062 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f5d5a7d0-7951-4159-8ff4-8ecd028ba324 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:29.306405 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f5d5a7d0-7951-4159-8ff4-8ecd028ba324 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1567 microversion: 2.1 time: 0.481412 Nov 24 03:07:29.308219 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 280/588] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:28 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1567 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:07:29.739719 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0e065e26-cd8b-4d5a-85a1-f0259effe7c8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:29.740331 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0e065e26-cd8b-4d5a-85a1-f0259effe7c8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:29.746931 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0e065e26-cd8b-4d5a-85a1-f0259effe7c8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:29.747374 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0e065e26-cd8b-4d5a-85a1-f0259effe7c8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:29.748173 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0e065e26-cd8b-4d5a-85a1-f0259effe7c8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:29.748601 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0e065e26-cd8b-4d5a-85a1-f0259effe7c8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:29.902993 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5e5947c7-15a2-409a-acf0-1ce0e51d1d69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:29.904000 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5e5947c7-15a2-409a-acf0-1ce0e51d1d69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:29.913357 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5e5947c7-15a2-409a-acf0-1ce0e51d1d69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:29.914048 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5e5947c7-15a2-409a-acf0-1ce0e51d1d69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:29.915270 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5e5947c7-15a2-409a-acf0-1ce0e51d1d69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:29.915945 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5e5947c7-15a2-409a-acf0-1ce0e51d1d69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:30.023348 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0e065e26-cd8b-4d5a-85a1-f0259effe7c8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:30.032784 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0e065e26-cd8b-4d5a-85a1-f0259effe7c8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1710 microversion: 2.1 time: 0.296665 Nov 24 03:07:30.038119 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 309/589] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:29 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1710 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:07:30.078633 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5e5947c7-15a2-409a-acf0-1ce0e51d1d69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:30.087618 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5e5947c7-15a2-409a-acf0-1ce0e51d1d69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:30.089301 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5e5947c7-15a2-409a-acf0-1ce0e51d1d69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:30.091095 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5e5947c7-15a2-409a-acf0-1ce0e51d1d69 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.193902 Nov 24 03:07:30.091664 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 281/590] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:29 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:07:30.151080 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4cacf4c4-8e77-43fc-8e5a-a827d99fd1ae tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:30.151677 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4cacf4c4-8e77-43fc-8e5a-a827d99fd1ae tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:30.159108 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4cacf4c4-8e77-43fc-8e5a-a827d99fd1ae tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:30.159816 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4cacf4c4-8e77-43fc-8e5a-a827d99fd1ae tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:30.160800 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4cacf4c4-8e77-43fc-8e5a-a827d99fd1ae tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:30.161388 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4cacf4c4-8e77-43fc-8e5a-a827d99fd1ae tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:30.329750 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8e897abf-7050-4396-bb44-e57e927d94bb tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:30.330458 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8e897abf-7050-4396-bb44-e57e927d94bb tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:30.338582 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8e897abf-7050-4396-bb44-e57e927d94bb tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:30.339166 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8e897abf-7050-4396-bb44-e57e927d94bb tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:30.340071 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8e897abf-7050-4396-bb44-e57e927d94bb tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:30.340718 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8e897abf-7050-4396-bb44-e57e927d94bb tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:30.466360 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4cacf4c4-8e77-43fc-8e5a-a827d99fd1ae tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:30.477974 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4cacf4c4-8e77-43fc-8e5a-a827d99fd1ae tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1273 microversion: 2.1 time: 0.330426 Nov 24 03:07:30.489210 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 310/591] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:30 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1273 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:30.506734 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8e897abf-7050-4396-bb44-e57e927d94bb tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:30.516301 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8e897abf-7050-4396-bb44-e57e927d94bb tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1547 microversion: 2.1 time: 0.194657 Nov 24 03:07:30.516926 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 282/592] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:30 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1547 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:07:30.535254 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-449d628a-95c1-4c73-af33-b1f586ef9fc1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:30.535952 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-449d628a-95c1-4c73-af33-b1f586ef9fc1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:30.542280 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-449d628a-95c1-4c73-af33-b1f586ef9fc1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:30.542846 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-449d628a-95c1-4c73-af33-b1f586ef9fc1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:30.543653 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-449d628a-95c1-4c73-af33-b1f586ef9fc1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:30.544089 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-449d628a-95c1-4c73-af33-b1f586ef9fc1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:30.661435 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-449d628a-95c1-4c73-af33-b1f586ef9fc1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] HTTP exception thrown: Cannot 'detach_volume' instance 6bd67a95-85a5-4669-bc7b-2d50f1716c54 while it is in vm_state rescued Nov 24 03:07:30.662284 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-449d628a-95c1-4c73-af33-b1f586ef9fc1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Returning 409 to user: Cannot 'detach_volume' instance 6bd67a95-85a5-4669-bc7b-2d50f1716c54 while it is in vm_state rescued {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:07:30.663313 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-449d628a-95c1-4c73-af33-b1f586ef9fc1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/os-volume_attachments/f8bb8cfa-7052-4e08-87cc-6b73d40979d2" status: 409 len: 152 microversion: 2.1 time: 0.133298 Nov 24 03:07:30.664070 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 311/593] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Nov 24 03:07:30 2021] DELETE /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/os-volume_attachments/f8bb8cfa-7052-4e08-87cc-6b73d40979d2 => generated 152 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 24 03:07:30.673615 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0d7ec5d5-3e5b-402a-af2c-5ce5e2f9fe55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:07:30.674256 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0d7ec5d5-3e5b-402a-af2c-5ce5e2f9fe55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:30.680298 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d7ec5d5-3e5b-402a-af2c-5ce5e2f9fe55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:30.680827 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d7ec5d5-3e5b-402a-af2c-5ce5e2f9fe55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:30.681683 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d7ec5d5-3e5b-402a-af2c-5ce5e2f9fe55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:30.682146 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d7ec5d5-3e5b-402a-af2c-5ce5e2f9fe55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:30.763838 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0d7ec5d5-3e5b-402a-af2c-5ce5e2f9fe55 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "POST /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/action" status: 202 len: 0 microversion: 2.1 time: 0.093894 Nov 24 03:07:30.766321 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 283/594] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:07:30 2021] POST /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:07:30.777608 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-9e57c012-79c1-48c6-afe8-8042a1b2bc09 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:30.779153 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-9e57c012-79c1-48c6-afe8-8042a1b2bc09 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:30.792977 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9e57c012-79c1-48c6-afe8-8042a1b2bc09 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:30.794083 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9e57c012-79c1-48c6-afe8-8042a1b2bc09 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:30.795563 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9e57c012-79c1-48c6-afe8-8042a1b2bc09 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:30.796835 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9e57c012-79c1-48c6-afe8-8042a1b2bc09 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:31.051505 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5ecccd8b-5071-4f07-a3b9-b20b5a5bc31f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:31.052234 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5ecccd8b-5071-4f07-a3b9-b20b5a5bc31f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:31.063019 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5ecccd8b-5071-4f07-a3b9-b20b5a5bc31f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:31.069041 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5ecccd8b-5071-4f07-a3b9-b20b5a5bc31f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:31.071077 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5ecccd8b-5071-4f07-a3b9-b20b5a5bc31f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:31.077336 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5ecccd8b-5071-4f07-a3b9-b20b5a5bc31f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:31.413164 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5ecccd8b-5071-4f07-a3b9-b20b5a5bc31f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:31.417896 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-9e57c012-79c1-48c6-afe8-8042a1b2bc09 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:31.426715 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5ecccd8b-5071-4f07-a3b9-b20b5a5bc31f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1714 microversion: 2.1 time: 0.379721 Nov 24 03:07:31.427814 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 284/595] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:31 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1714 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:31.430161 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-9e57c012-79c1-48c6-afe8-8042a1b2bc09 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1555 microversion: 2.1 time: 0.657886 Nov 24 03:07:31.432722 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 312/596] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:30 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1555 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:31.434807 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-36fd9730-3f7f-4f87-a0a0-fb06948d35ce tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:31.435921 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-36fd9730-3f7f-4f87-a0a0-fb06948d35ce tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:31.446622 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36fd9730-3f7f-4f87-a0a0-fb06948d35ce tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:31.447366 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36fd9730-3f7f-4f87-a0a0-fb06948d35ce tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:31.458180 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36fd9730-3f7f-4f87-a0a0-fb06948d35ce tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:31.459363 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36fd9730-3f7f-4f87-a0a0-fb06948d35ce tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:31.499184 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e58ad8b4-b157-453c-80f0-cd94279abed3 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:31.500367 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e58ad8b4-b157-453c-80f0-cd94279abed3 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:31.513162 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e58ad8b4-b157-453c-80f0-cd94279abed3 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:31.513616 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e58ad8b4-b157-453c-80f0-cd94279abed3 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:31.514512 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e58ad8b4-b157-453c-80f0-cd94279abed3 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:31.514894 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e58ad8b4-b157-453c-80f0-cd94279abed3 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:31.806358 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e58ad8b4-b157-453c-80f0-cd94279abed3 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:31.817812 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e58ad8b4-b157-453c-80f0-cd94279abed3 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1261 microversion: 2.1 time: 0.324117 Nov 24 03:07:31.818507 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 313/597] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:31 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1261 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:31.838138 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-1322c1ad-f597-4b76-84ac-1b6319fa337e req-d7b6bf29-d5d1-4af3-a698-68402d9017d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262867ad-b362-4696-9425-81751e68d74f", "tag": "74c8f067-ea92-4a51-9064-326e74424693"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:07:31.840519 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:07:31.840519 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:07:31.856533 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-1322c1ad-f597-4b76-84ac-1b6319fa337e req-d7b6bf29-d5d1-4af3-a698-68402d9017d6 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:31.857583 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-1322c1ad-f597-4b76-84ac-1b6319fa337e req-d7b6bf29-d5d1-4af3-a698-68402d9017d6 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:31.881867 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-1322c1ad-f597-4b76-84ac-1b6319fa337e req-d7b6bf29-d5d1-4af3-a698-68402d9017d6 service nova] Creating event network-changed:74c8f067-ea92-4a51-9064-326e74424693 for instance 262867ad-b362-4696-9425-81751e68d74f on hv-cinder-81803 Nov 24 03:07:31.900398 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-1322c1ad-f597-4b76-84ac-1b6319fa337e req-d7b6bf29-d5d1-4af3-a698-68402d9017d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078724 Nov 24 03:07:31.901640 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 314/598] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:07:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:07:31.907359 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-36fd9730-3f7f-4f87-a0a0-fb06948d35ce tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:31.919932 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-36fd9730-3f7f-4f87-a0a0-fb06948d35ce tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:31.921556 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-36fd9730-3f7f-4f87-a0a0-fb06948d35ce tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:31.923270 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-36fd9730-3f7f-4f87-a0a0-fb06948d35ce tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.494184 Nov 24 03:07:31.924225 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 285/599] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:31 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:32.465860 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-32c28d99-1fb0-437b-bff3-f3c3dd58df25 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:32.466718 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-32c28d99-1fb0-437b-bff3-f3c3dd58df25 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:32.475508 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-32c28d99-1fb0-437b-bff3-f3c3dd58df25 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:32.476080 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-32c28d99-1fb0-437b-bff3-f3c3dd58df25 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:32.477389 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-32c28d99-1fb0-437b-bff3-f3c3dd58df25 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:32.477945 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-32c28d99-1fb0-437b-bff3-f3c3dd58df25 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:32.637401 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-32c28d99-1fb0-437b-bff3-f3c3dd58df25 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:32.646605 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-32c28d99-1fb0-437b-bff3-f3c3dd58df25 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1555 microversion: 2.1 time: 0.185339 Nov 24 03:07:32.647150 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 315/600] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:32 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:32.848757 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f46ce0a7-e529-4c65-9d0d-314d30ea5dba tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:32.849690 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f46ce0a7-e529-4c65-9d0d-314d30ea5dba tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:32.857585 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f46ce0a7-e529-4c65-9d0d-314d30ea5dba tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:32.858098 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f46ce0a7-e529-4c65-9d0d-314d30ea5dba tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:32.859185 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f46ce0a7-e529-4c65-9d0d-314d30ea5dba tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:32.859942 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f46ce0a7-e529-4c65-9d0d-314d30ea5dba tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:32.942330 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7fcfa1eb-1f52-4e54-889a-f19b37eb8d74 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:32.942977 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-7fcfa1eb-1f52-4e54-889a-f19b37eb8d74 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:32.949955 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7fcfa1eb-1f52-4e54-889a-f19b37eb8d74 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:32.950731 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7fcfa1eb-1f52-4e54-889a-f19b37eb8d74 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:32.951528 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7fcfa1eb-1f52-4e54-889a-f19b37eb8d74 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:32.951938 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7fcfa1eb-1f52-4e54-889a-f19b37eb8d74 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:33.035507 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f46ce0a7-e529-4c65-9d0d-314d30ea5dba tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:33.044208 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f46ce0a7-e529-4c65-9d0d-314d30ea5dba tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1261 microversion: 2.1 time: 0.201385 Nov 24 03:07:33.045124 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 286/601] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:32 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1261 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:33.123767 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7fcfa1eb-1f52-4e54-889a-f19b37eb8d74 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:33.134148 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7fcfa1eb-1f52-4e54-889a-f19b37eb8d74 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:33.136715 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7fcfa1eb-1f52-4e54-889a-f19b37eb8d74 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:33.138070 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7fcfa1eb-1f52-4e54-889a-f19b37eb8d74 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.199646 Nov 24 03:07:33.139123 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 316/602] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:32 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:33.218268 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-8f800bc6-2df3-45fe-9492-b10a20debfe8 req-20b2da44-7d5c-435e-aa81-a9ffc0b8235c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfaf6d4e-4188-451d-8af8-32300d13ae2d", "name": "network-vif-plugged", "status": "completed", "tag": "521a966d-715d-42d8-a2e3-077f7788aac2"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:07:33.220637 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:07:33.220637 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:07:33.229764 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-8f800bc6-2df3-45fe-9492-b10a20debfe8 req-20b2da44-7d5c-435e-aa81-a9ffc0b8235c service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:33.230487 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-8f800bc6-2df3-45fe-9492-b10a20debfe8 req-20b2da44-7d5c-435e-aa81-a9ffc0b8235c service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:33.244084 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-8f800bc6-2df3-45fe-9492-b10a20debfe8 req-20b2da44-7d5c-435e-aa81-a9ffc0b8235c service nova] Creating event network-vif-plugged:521a966d-715d-42d8-a2e3-077f7788aac2 for instance dfaf6d4e-4188-451d-8af8-32300d13ae2d on hv-cinder-81803 Nov 24 03:07:33.251045 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-8f800bc6-2df3-45fe-9492-b10a20debfe8 req-20b2da44-7d5c-435e-aa81-a9ffc0b8235c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035718 Nov 24 03:07:33.251936 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 287/603] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:07:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:07:33.664869 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b2c20c6b-e795-4a2e-9186-9025038c88e7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:33.665406 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b2c20c6b-e795-4a2e-9186-9025038c88e7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:33.672911 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b2c20c6b-e795-4a2e-9186-9025038c88e7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:33.673543 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b2c20c6b-e795-4a2e-9186-9025038c88e7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:33.674770 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b2c20c6b-e795-4a2e-9186-9025038c88e7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:33.675244 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b2c20c6b-e795-4a2e-9186-9025038c88e7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:33.828717 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b2c20c6b-e795-4a2e-9186-9025038c88e7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:33.843414 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b2c20c6b-e795-4a2e-9186-9025038c88e7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1555 microversion: 2.1 time: 0.182545 Nov 24 03:07:33.844211 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 317/604] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:33 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1555 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:34.063269 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-84936dce-eed9-4a08-867b-b0c9d224909d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:34.063895 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-84936dce-eed9-4a08-867b-b0c9d224909d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:34.073089 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-84936dce-eed9-4a08-867b-b0c9d224909d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:34.073683 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-84936dce-eed9-4a08-867b-b0c9d224909d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:34.074965 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-84936dce-eed9-4a08-867b-b0c9d224909d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:34.075476 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-84936dce-eed9-4a08-867b-b0c9d224909d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:34.158774 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-d5fd386f-2d69-4aed-a421-97e400cffc48 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:34.160451 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-d5fd386f-2d69-4aed-a421-97e400cffc48 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:34.169579 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d5fd386f-2d69-4aed-a421-97e400cffc48 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:34.170525 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d5fd386f-2d69-4aed-a421-97e400cffc48 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:34.171601 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d5fd386f-2d69-4aed-a421-97e400cffc48 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:34.172365 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d5fd386f-2d69-4aed-a421-97e400cffc48 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:34.227237 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-84936dce-eed9-4a08-867b-b0c9d224909d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:34.236069 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-84936dce-eed9-4a08-867b-b0c9d224909d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1261 microversion: 2.1 time: 0.177380 Nov 24 03:07:34.236984 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 288/605] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:34 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1261 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:34.323116 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-d5fd386f-2d69-4aed-a421-97e400cffc48 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:34.332459 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-d5fd386f-2d69-4aed-a421-97e400cffc48 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:34.334031 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-d5fd386f-2d69-4aed-a421-97e400cffc48 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:34.335212 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-d5fd386f-2d69-4aed-a421-97e400cffc48 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.181587 Nov 24 03:07:34.335767 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 318/606] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:34 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:34.861238 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0677d644-abb5-4258-8fd5-9cf767ee2c53 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:34.862098 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0677d644-abb5-4258-8fd5-9cf767ee2c53 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:34.868580 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0677d644-abb5-4258-8fd5-9cf767ee2c53 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:34.869022 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0677d644-abb5-4258-8fd5-9cf767ee2c53 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:34.869819 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0677d644-abb5-4258-8fd5-9cf767ee2c53 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:34.870306 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0677d644-abb5-4258-8fd5-9cf767ee2c53 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:35.016433 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0677d644-abb5-4258-8fd5-9cf767ee2c53 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:35.024596 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0677d644-abb5-4258-8fd5-9cf767ee2c53 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1561 microversion: 2.1 time: 0.167540 Nov 24 03:07:35.025180 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 289/607] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:34 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:35.093870 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c83ee74e-24ad-4d94-9554-877aeca1bf79 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:35.094403 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c83ee74e-24ad-4d94-9554-877aeca1bf79 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:35.100768 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c83ee74e-24ad-4d94-9554-877aeca1bf79 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:35.101230 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c83ee74e-24ad-4d94-9554-877aeca1bf79 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:35.102060 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c83ee74e-24ad-4d94-9554-877aeca1bf79 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:35.102501 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c83ee74e-24ad-4d94-9554-877aeca1bf79 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:35.193826 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.objects.instance [None req-c83ee74e-24ad-4d94-9554-877aeca1bf79 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lazy-loading 'services' on Instance uuid 6bd67a95-85a5-4669-bc7b-2d50f1716c54 {{(pid=116331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:07:35.253373 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e8255ccc-7d17-438b-8857-e7b914e4409d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:35.254103 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e8255ccc-7d17-438b-8857-e7b914e4409d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:35.262825 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8255ccc-7d17-438b-8857-e7b914e4409d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:35.263306 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8255ccc-7d17-438b-8857-e7b914e4409d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:35.264237 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8255ccc-7d17-438b-8857-e7b914e4409d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:35.264713 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8255ccc-7d17-438b-8857-e7b914e4409d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:35.277103 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c83ee74e-24ad-4d94-9554-877aeca1bf79 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/os-volume_attachments/f8bb8cfa-7052-4e08-87cc-6b73d40979d2" status: 202 len: 0 microversion: 2.1 time: 0.186627 Nov 24 03:07:35.278139 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 319/608] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Nov 24 03:07:35 2021] DELETE /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/os-volume_attachments/f8bb8cfa-7052-4e08-87cc-6b73d40979d2 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:07:35.287751 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-953d2799-585d-426e-9c7e-2dd308d84e2c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:35.289350 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-953d2799-585d-426e-9c7e-2dd308d84e2c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:35.299443 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-953d2799-585d-426e-9c7e-2dd308d84e2c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:35.300238 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-953d2799-585d-426e-9c7e-2dd308d84e2c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:35.301298 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-953d2799-585d-426e-9c7e-2dd308d84e2c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:35.302054 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-953d2799-585d-426e-9c7e-2dd308d84e2c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:35.339453 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-953d2799-585d-426e-9c7e-2dd308d84e2c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056361 Nov 24 03:07:35.340485 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 320/609] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Nov 24 03:07:35 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:07:35.358192 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f99c60d4-4d35-4ff4-9f3b-8733fb6ba4ba tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:35.358839 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f99c60d4-4d35-4ff4-9f3b-8733fb6ba4ba tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:35.386514 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f99c60d4-4d35-4ff4-9f3b-8733fb6ba4ba tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:35.386617 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f99c60d4-4d35-4ff4-9f3b-8733fb6ba4ba tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:35.395288 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f99c60d4-4d35-4ff4-9f3b-8733fb6ba4ba tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:35.395737 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f99c60d4-4d35-4ff4-9f3b-8733fb6ba4ba tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:35.476813 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e8255ccc-7d17-438b-8857-e7b914e4409d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:35.487739 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e8255ccc-7d17-438b-8857-e7b914e4409d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1261 microversion: 2.1 time: 0.237780 Nov 24 03:07:35.489118 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 290/610] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:35 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1261 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:35.566182 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f99c60d4-4d35-4ff4-9f3b-8733fb6ba4ba tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:35.574697 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f99c60d4-4d35-4ff4-9f3b-8733fb6ba4ba tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:35.576195 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f99c60d4-4d35-4ff4-9f3b-8733fb6ba4ba tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:35.577383 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f99c60d4-4d35-4ff4-9f3b-8733fb6ba4ba tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1809 microversion: 2.20 time: 0.228371 Nov 24 03:07:35.578039 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 321/611] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:35 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1809 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:36.351913 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-befd0aab-380b-44ac-ad85-41457920b269 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:36.352841 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-befd0aab-380b-44ac-ad85-41457920b269 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:36.359798 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-befd0aab-380b-44ac-ad85-41457920b269 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:36.360279 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-befd0aab-380b-44ac-ad85-41457920b269 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:36.361055 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-befd0aab-380b-44ac-ad85-41457920b269 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:36.361492 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-befd0aab-380b-44ac-ad85-41457920b269 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:36.391804 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-befd0aab-380b-44ac-ad85-41457920b269 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043664 Nov 24 03:07:36.392699 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 291/612] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Nov 24 03:07:36 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 03:07:36.505752 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-daf04929-bfca-4cec-b73a-af194bb8e21f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:36.506390 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-daf04929-bfca-4cec-b73a-af194bb8e21f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:36.513614 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-daf04929-bfca-4cec-b73a-af194bb8e21f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:36.514221 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-daf04929-bfca-4cec-b73a-af194bb8e21f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:36.515149 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-daf04929-bfca-4cec-b73a-af194bb8e21f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:36.515618 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-daf04929-bfca-4cec-b73a-af194bb8e21f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:36.595477 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-574c0840-108e-4166-b64e-99e503e072f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:36.596149 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-574c0840-108e-4166-b64e-99e503e072f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:36.602215 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-574c0840-108e-4166-b64e-99e503e072f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:36.602673 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-574c0840-108e-4166-b64e-99e503e072f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:36.603463 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-574c0840-108e-4166-b64e-99e503e072f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:36.603901 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-574c0840-108e-4166-b64e-99e503e072f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:36.654325 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-daf04929-bfca-4cec-b73a-af194bb8e21f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:36.662003 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-daf04929-bfca-4cec-b73a-af194bb8e21f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1261 microversion: 2.1 time: 0.160074 Nov 24 03:07:36.662607 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 322/613] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:36 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:36.744884 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-574c0840-108e-4166-b64e-99e503e072f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:36.753721 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-574c0840-108e-4166-b64e-99e503e072f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:36.755274 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-574c0840-108e-4166-b64e-99e503e072f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:36.756453 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-574c0840-108e-4166-b64e-99e503e072f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1796 microversion: 2.20 time: 0.164919 Nov 24 03:07:36.757028 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 292/614] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:07:36 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1796 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:07:37.679012 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-54ac5bf0-7e96-40ed-aea2-40fe595a1bd5 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:37.679624 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-54ac5bf0-7e96-40ed-aea2-40fe595a1bd5 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:37.686614 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-54ac5bf0-7e96-40ed-aea2-40fe595a1bd5 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:37.687311 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-54ac5bf0-7e96-40ed-aea2-40fe595a1bd5 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:37.688080 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-54ac5bf0-7e96-40ed-aea2-40fe595a1bd5 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:37.688523 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-54ac5bf0-7e96-40ed-aea2-40fe595a1bd5 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:37.838755 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-54ac5bf0-7e96-40ed-aea2-40fe595a1bd5 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:37.847245 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-54ac5bf0-7e96-40ed-aea2-40fe595a1bd5 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1261 microversion: 2.1 time: 0.171790 Nov 24 03:07:37.847880 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 323/615] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:37 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:38.725124 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4f710ece-6736-433f-add4-152e14ca1c43 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:38.725681 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4f710ece-6736-433f-add4-152e14ca1c43 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:38.732954 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4f710ece-6736-433f-add4-152e14ca1c43 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:38.733403 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4f710ece-6736-433f-add4-152e14ca1c43 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:38.734221 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4f710ece-6736-433f-add4-152e14ca1c43 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:38.734651 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4f710ece-6736-433f-add4-152e14ca1c43 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:38.761838 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4f710ece-6736-433f-add4-152e14ca1c43 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:07:38.852576 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4f710ece-6736-433f-add4-152e14ca1c43 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 204 len: 0 microversion: 2.1 time: 0.130824 Nov 24 03:07:38.853180 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 293/616] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:07:38 2021] DELETE /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:07:38.865650 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9ed73755-0a1d-43b9-bf3f-e828f9804418 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:38.866174 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-072de190-b61b-420a-ab90-2331280fc00a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:38.866891 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9ed73755-0a1d-43b9-bf3f-e828f9804418 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:38.867290 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-072de190-b61b-420a-ab90-2331280fc00a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:38.874442 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ed73755-0a1d-43b9-bf3f-e828f9804418 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:38.874893 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ed73755-0a1d-43b9-bf3f-e828f9804418 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:38.876035 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ed73755-0a1d-43b9-bf3f-e828f9804418 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:38.876787 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ed73755-0a1d-43b9-bf3f-e828f9804418 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:38.880929 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-072de190-b61b-420a-ab90-2331280fc00a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:38.881732 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-072de190-b61b-420a-ab90-2331280fc00a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:38.883186 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-072de190-b61b-420a-ab90-2331280fc00a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:38.883949 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-072de190-b61b-420a-ab90-2331280fc00a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:39.042535 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-072de190-b61b-420a-ab90-2331280fc00a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:39.051169 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-072de190-b61b-420a-ab90-2331280fc00a tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1508 microversion: 2.1 time: 0.190629 Nov 24 03:07:39.051760 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 324/617] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:38 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1508 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:39.065710 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9ed73755-0a1d-43b9-bf3f-e828f9804418 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:39.073489 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9ed73755-0a1d-43b9-bf3f-e828f9804418 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1261 microversion: 2.1 time: 0.212091 Nov 24 03:07:39.074455 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 294/618] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:38 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1261 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:07:40.074740 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ef7d2891-c9b3-4426-aab3-ef185abc26ed tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:40.075734 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ef7d2891-c9b3-4426-aab3-ef185abc26ed tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:40.087582 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ef7d2891-c9b3-4426-aab3-ef185abc26ed tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:40.088404 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ef7d2891-c9b3-4426-aab3-ef185abc26ed tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:40.089803 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ef7d2891-c9b3-4426-aab3-ef185abc26ed tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:40.090633 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ef7d2891-c9b3-4426-aab3-ef185abc26ed tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:40.098050 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5a15b5e6-4bd4-4ba0-bef8-5ffd3f29b0ab tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:40.098695 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5a15b5e6-4bd4-4ba0-bef8-5ffd3f29b0ab tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:40.114369 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5a15b5e6-4bd4-4ba0-bef8-5ffd3f29b0ab tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:40.114823 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5a15b5e6-4bd4-4ba0-bef8-5ffd3f29b0ab tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:40.115641 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5a15b5e6-4bd4-4ba0-bef8-5ffd3f29b0ab tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:40.116085 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5a15b5e6-4bd4-4ba0-bef8-5ffd3f29b0ab tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:40.265264 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ef7d2891-c9b3-4426-aab3-ef185abc26ed tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:40.274089 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ef7d2891-c9b3-4426-aab3-ef185abc26ed tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1508 microversion: 2.1 time: 0.205222 Nov 24 03:07:40.274681 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 325/619] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:40 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:40.287894 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5a15b5e6-4bd4-4ba0-bef8-5ffd3f29b0ab tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:40.296088 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5a15b5e6-4bd4-4ba0-bef8-5ffd3f29b0ab tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1261 microversion: 2.1 time: 0.201621 Nov 24 03:07:40.296687 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 295/620] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:40 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1261 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:41.291607 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4709c94d-fc04-4458-9132-eeb5b520f2bc tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:41.292413 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4709c94d-fc04-4458-9132-eeb5b520f2bc tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:41.299657 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4709c94d-fc04-4458-9132-eeb5b520f2bc tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:41.300357 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4709c94d-fc04-4458-9132-eeb5b520f2bc tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:41.300974 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4709c94d-fc04-4458-9132-eeb5b520f2bc tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:41.301428 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4709c94d-fc04-4458-9132-eeb5b520f2bc tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:41.314170 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-48b7929a-c032-4824-827e-6102f63341d0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:41.314749 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-48b7929a-c032-4824-827e-6102f63341d0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:41.321402 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-48b7929a-c032-4824-827e-6102f63341d0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:41.321853 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-48b7929a-c032-4824-827e-6102f63341d0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:41.322671 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-48b7929a-c032-4824-827e-6102f63341d0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:41.323113 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-48b7929a-c032-4824-827e-6102f63341d0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:41.462349 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4709c94d-fc04-4458-9132-eeb5b520f2bc tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:41.470064 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4709c94d-fc04-4458-9132-eeb5b520f2bc tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1508 microversion: 2.1 time: 0.182200 Nov 24 03:07:41.470690 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 326/621] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:41 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:41.472366 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-48b7929a-c032-4824-827e-6102f63341d0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:41.480641 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-48b7929a-c032-4824-827e-6102f63341d0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1261 microversion: 2.1 time: 0.170122 Nov 24 03:07:41.481164 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 296/622] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:41 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:42.138763 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-b1a6e08b-3c64-4b02-92cd-300c21cdc5e1 req-311dcd16-13be-4fad-84ca-0c1887e8decd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262867ad-b362-4696-9425-81751e68d74f", "name": "network-vif-plugged", "status": "completed", "tag": "74c8f067-ea92-4a51-9064-326e74424693"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:07:42.140405 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:07:42.140405 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:07:42.149136 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-b1a6e08b-3c64-4b02-92cd-300c21cdc5e1 req-311dcd16-13be-4fad-84ca-0c1887e8decd service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:42.149681 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-b1a6e08b-3c64-4b02-92cd-300c21cdc5e1 req-311dcd16-13be-4fad-84ca-0c1887e8decd service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:42.163163 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-b1a6e08b-3c64-4b02-92cd-300c21cdc5e1 req-311dcd16-13be-4fad-84ca-0c1887e8decd service nova] Creating event network-vif-plugged:74c8f067-ea92-4a51-9064-326e74424693 for instance 262867ad-b362-4696-9425-81751e68d74f on hv-cinder-81803 Nov 24 03:07:42.174412 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-b1a6e08b-3c64-4b02-92cd-300c21cdc5e1 req-311dcd16-13be-4fad-84ca-0c1887e8decd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038896 Nov 24 03:07:42.175023 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 327/623] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:07:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:07:42.487683 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f0675987-e60c-4f3b-8bf6-3cfe7cbfee67 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:42.488258 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f0675987-e60c-4f3b-8bf6-3cfe7cbfee67 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:42.497295 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f0675987-e60c-4f3b-8bf6-3cfe7cbfee67 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:42.497948 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f0675987-e60c-4f3b-8bf6-3cfe7cbfee67 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:42.498878 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f0675987-e60c-4f3b-8bf6-3cfe7cbfee67 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:42.499535 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f0675987-e60c-4f3b-8bf6-3cfe7cbfee67 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:42.500261 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0bd3354d-6e38-4c59-b43a-1af750336301 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:42.500986 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0bd3354d-6e38-4c59-b43a-1af750336301 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:42.507596 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0bd3354d-6e38-4c59-b43a-1af750336301 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:42.508027 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0bd3354d-6e38-4c59-b43a-1af750336301 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:42.508834 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0bd3354d-6e38-4c59-b43a-1af750336301 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:42.509268 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0bd3354d-6e38-4c59-b43a-1af750336301 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:42.673019 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0bd3354d-6e38-4c59-b43a-1af750336301 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:42.680280 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f0675987-e60c-4f3b-8bf6-3cfe7cbfee67 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:42.682261 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0bd3354d-6e38-4c59-b43a-1af750336301 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1261 microversion: 2.1 time: 0.186836 Nov 24 03:07:42.683275 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 328/624] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:42 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1261 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:07:42.693552 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f0675987-e60c-4f3b-8bf6-3cfe7cbfee67 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1508 microversion: 2.1 time: 0.207392 Nov 24 03:07:42.694711 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 297/625] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:42 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1508 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:43.709537 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-55643b80-109f-48c4-b951-d19f97d6968d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:43.710506 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-55643b80-109f-48c4-b951-d19f97d6968d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:43.712604 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-33b51186-801a-4461-aabb-f620e1dcd2a8 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:43.714074 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-33b51186-801a-4461-aabb-f620e1dcd2a8 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:43.718815 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-55643b80-109f-48c4-b951-d19f97d6968d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:43.719271 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-55643b80-109f-48c4-b951-d19f97d6968d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:43.720518 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-55643b80-109f-48c4-b951-d19f97d6968d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:43.720965 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-55643b80-109f-48c4-b951-d19f97d6968d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:43.721358 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-33b51186-801a-4461-aabb-f620e1dcd2a8 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:43.721813 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-33b51186-801a-4461-aabb-f620e1dcd2a8 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:43.722645 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-33b51186-801a-4461-aabb-f620e1dcd2a8 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:43.723076 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-33b51186-801a-4461-aabb-f620e1dcd2a8 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:43.881530 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-55643b80-109f-48c4-b951-d19f97d6968d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:43.884319 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-33b51186-801a-4461-aabb-f620e1dcd2a8 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:43.889585 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-55643b80-109f-48c4-b951-d19f97d6968d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1261 microversion: 2.1 time: 0.184746 Nov 24 03:07:43.890217 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 329/626] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:43 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:43.892778 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-33b51186-801a-4461-aabb-f620e1dcd2a8 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1508 microversion: 2.1 time: 0.185031 Nov 24 03:07:43.893361 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 298/627] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:43 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:44.907522 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-38ac8408-b691-4dcb-a6af-c074110d0f2c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:44.908149 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-38ac8408-b691-4dcb-a6af-c074110d0f2c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:44.910283 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-43113f7f-dcfa-477d-bf5e-d86e412d1ea7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:44.910996 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-43113f7f-dcfa-477d-bf5e-d86e412d1ea7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:44.916846 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-38ac8408-b691-4dcb-a6af-c074110d0f2c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:44.917906 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-38ac8408-b691-4dcb-a6af-c074110d0f2c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:44.918105 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-43113f7f-dcfa-477d-bf5e-d86e412d1ea7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:44.918387 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-43113f7f-dcfa-477d-bf5e-d86e412d1ea7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:44.919057 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-38ac8408-b691-4dcb-a6af-c074110d0f2c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:44.919345 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-43113f7f-dcfa-477d-bf5e-d86e412d1ea7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:44.919563 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-38ac8408-b691-4dcb-a6af-c074110d0f2c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:44.919816 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-43113f7f-dcfa-477d-bf5e-d86e412d1ea7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:45.068859 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-43113f7f-dcfa-477d-bf5e-d86e412d1ea7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:45.069950 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-38ac8408-b691-4dcb-a6af-c074110d0f2c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:45.077312 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-43113f7f-dcfa-477d-bf5e-d86e412d1ea7 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1508 microversion: 2.1 time: 0.170664 Nov 24 03:07:45.077575 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-38ac8408-b691-4dcb-a6af-c074110d0f2c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1261 microversion: 2.1 time: 0.173852 Nov 24 03:07:45.077929 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 299/628] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:44 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:07:45.078133 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 330/629] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:44 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:46.095291 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-16212c04-1881-4f4b-bad4-ab961599df29 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:46.096179 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-29193596-8a2b-48e9-bb66-da17ed8c18c0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:46.096663 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-16212c04-1881-4f4b-bad4-ab961599df29 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:46.096839 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-29193596-8a2b-48e9-bb66-da17ed8c18c0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:46.104482 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-29193596-8a2b-48e9-bb66-da17ed8c18c0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:46.104734 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16212c04-1881-4f4b-bad4-ab961599df29 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:46.104863 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-29193596-8a2b-48e9-bb66-da17ed8c18c0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:46.105056 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16212c04-1881-4f4b-bad4-ab961599df29 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:46.105551 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-29193596-8a2b-48e9-bb66-da17ed8c18c0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:46.105906 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16212c04-1881-4f4b-bad4-ab961599df29 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:46.106046 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-29193596-8a2b-48e9-bb66-da17ed8c18c0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:46.106466 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16212c04-1881-4f4b-bad4-ab961599df29 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:46.254261 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-16212c04-1881-4f4b-bad4-ab961599df29 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:46.259624 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-29193596-8a2b-48e9-bb66-da17ed8c18c0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:46.262257 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-16212c04-1881-4f4b-bad4-ab961599df29 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1508 microversion: 2.1 time: 0.171272 Nov 24 03:07:46.262911 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 300/630] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:46 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:46.267863 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-29193596-8a2b-48e9-bb66-da17ed8c18c0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1261 microversion: 2.1 time: 0.176905 Nov 24 03:07:46.268435 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 331/631] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:46 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:47.280046 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-287e8026-b058-48c1-8c5d-f2c85115e6ba tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:47.280848 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-287e8026-b058-48c1-8c5d-f2c85115e6ba tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:47.286104 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e3cfe1e7-6ba1-493c-bf8d-7d6ce854e67c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:47.287001 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e3cfe1e7-6ba1-493c-bf8d-7d6ce854e67c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:47.289272 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-287e8026-b058-48c1-8c5d-f2c85115e6ba tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:47.289731 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-287e8026-b058-48c1-8c5d-f2c85115e6ba tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:47.291170 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-287e8026-b058-48c1-8c5d-f2c85115e6ba tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:47.291170 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-287e8026-b058-48c1-8c5d-f2c85115e6ba tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:47.295408 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e3cfe1e7-6ba1-493c-bf8d-7d6ce854e67c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:47.295980 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e3cfe1e7-6ba1-493c-bf8d-7d6ce854e67c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:47.297321 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e3cfe1e7-6ba1-493c-bf8d-7d6ce854e67c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:47.297766 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e3cfe1e7-6ba1-493c-bf8d-7d6ce854e67c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:47.459576 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e3cfe1e7-6ba1-493c-bf8d-7d6ce854e67c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:47.474457 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e3cfe1e7-6ba1-493c-bf8d-7d6ce854e67c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1261 microversion: 2.1 time: 0.192636 Nov 24 03:07:47.475481 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-287e8026-b058-48c1-8c5d-f2c85115e6ba tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:47.475766 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 332/632] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:47 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1261 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:47.494611 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-287e8026-b058-48c1-8c5d-f2c85115e6ba tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1508 microversion: 2.1 time: 0.218234 Nov 24 03:07:47.495458 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 301/633] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:47 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1508 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:47.964386 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-41e87c7f-3cd7-4ac5-9447-26032b44d649 req-ecbf8447-c695-4f94-ac02-07de13ff8f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfde9ed7-de6c-421b-bb42-46506b2ef81d", "name": "network-vif-deleted", "tag": "e1dd953c-f2a6-4135-a4b0-00a1cb515b08"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:07:47.966008 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:07:47.966008 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:07:47.973641 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-41e87c7f-3cd7-4ac5-9447-26032b44d649 req-ecbf8447-c695-4f94-ac02-07de13ff8f9d service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:47.974271 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-41e87c7f-3cd7-4ac5-9447-26032b44d649 req-ecbf8447-c695-4f94-ac02-07de13ff8f9d service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:47.987750 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-41e87c7f-3cd7-4ac5-9447-26032b44d649 req-ecbf8447-c695-4f94-ac02-07de13ff8f9d service nova] Creating event network-vif-deleted:e1dd953c-f2a6-4135-a4b0-00a1cb515b08 for instance bfde9ed7-de6c-421b-bb42-46506b2ef81d on hv-cinder-81803 Nov 24 03:07:48.004715 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-41e87c7f-3cd7-4ac5-9447-26032b44d649 req-ecbf8447-c695-4f94-ac02-07de13ff8f9d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043772 Nov 24 03:07:48.005303 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 333/634] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:07:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:07:48.494211 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0d75a938-5ca8-4e33-a99f-6a405e3819a1 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:48.495109 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0d75a938-5ca8-4e33-a99f-6a405e3819a1 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:48.502357 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d75a938-5ca8-4e33-a99f-6a405e3819a1 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:48.502789 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d75a938-5ca8-4e33-a99f-6a405e3819a1 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:48.503609 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d75a938-5ca8-4e33-a99f-6a405e3819a1 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:48.504029 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d75a938-5ca8-4e33-a99f-6a405e3819a1 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:48.514448 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4156459a-1cbf-4c8f-acc0-ac1364f930e0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:48.515317 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4156459a-1cbf-4c8f-acc0-ac1364f930e0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:48.527477 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4156459a-1cbf-4c8f-acc0-ac1364f930e0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:48.528613 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4156459a-1cbf-4c8f-acc0-ac1364f930e0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:48.530251 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4156459a-1cbf-4c8f-acc0-ac1364f930e0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:48.531168 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4156459a-1cbf-4c8f-acc0-ac1364f930e0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:48.585642 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4156459a-1cbf-4c8f-acc0-ac1364f930e0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:48.586141 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4156459a-1cbf-4c8f-acc0-ac1364f930e0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:48.586597 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.objects.instance [None req-4156459a-1cbf-4c8f-acc0-ac1364f930e0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lazy-loading 'fault' on Instance uuid bfde9ed7-de6c-421b-bb42-46506b2ef81d {{(pid=116331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:07:48.635440 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4156459a-1cbf-4c8f-acc0-ac1364f930e0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:48.647972 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4156459a-1cbf-4c8f-acc0-ac1364f930e0 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 200 len: 1311 microversion: 2.1 time: 0.139295 Nov 24 03:07:48.658008 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 334/635] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:48 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 1311 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:07:48.701552 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0d75a938-5ca8-4e33-a99f-6a405e3819a1 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:48.713733 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0d75a938-5ca8-4e33-a99f-6a405e3819a1 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1261 microversion: 2.1 time: 0.224588 Nov 24 03:07:48.714851 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 302/636] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:48 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1261 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:48.935648 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-1df316b5-1789-4e6a-8e88-e45c39c18835 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:07:48.937379 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-1df316b5-1789-4e6a-8e88-e45c39c18835 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:48.945483 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1df316b5-1789-4e6a-8e88-e45c39c18835 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:48.945967 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1df316b5-1789-4e6a-8e88-e45c39c18835 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:48.946759 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1df316b5-1789-4e6a-8e88-e45c39c18835 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:48.947200 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1df316b5-1789-4e6a-8e88-e45c39c18835 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:49.038393 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-1df316b5-1789-4e6a-8e88-e45c39c18835 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "POST /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c/action" status: 202 len: 0 microversion: 2.1 time: 0.108644 Nov 24 03:07:49.039460 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 335/637] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:07:48 2021] POST /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 03:07:49.048066 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-68fa208c-e799-4ccf-b64b-b3039819faff tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:49.048687 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-68fa208c-e799-4ccf-b64b-b3039819faff tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:49.055176 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-68fa208c-e799-4ccf-b64b-b3039819faff tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:49.055612 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-68fa208c-e799-4ccf-b64b-b3039819faff tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:49.056414 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-68fa208c-e799-4ccf-b64b-b3039819faff tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:49.056846 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-68fa208c-e799-4ccf-b64b-b3039819faff tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:49.304390 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-68fa208c-e799-4ccf-b64b-b3039819faff tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:49.312566 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-68fa208c-e799-4ccf-b64b-b3039819faff tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1752 microversion: 2.1 time: 0.268125 Nov 24 03:07:49.313381 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 303/638] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:49 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1752 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:07:49.668194 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-20ed2e96-e997-4352-85b8-db63fc5d764c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:49.668905 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-20ed2e96-e997-4352-85b8-db63fc5d764c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: bfde9ed7-de6c-421b-bb42-46506b2ef81d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:49.675878 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-20ed2e96-e997-4352-85b8-db63fc5d764c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:49.676480 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-20ed2e96-e997-4352-85b8-db63fc5d764c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:49.677303 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-20ed2e96-e997-4352-85b8-db63fc5d764c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:49.677834 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-20ed2e96-e997-4352-85b8-db63fc5d764c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:49.692366 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-20ed2e96-e997-4352-85b8-db63fc5d764c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] HTTP exception thrown: Instance bfde9ed7-de6c-421b-bb42-46506b2ef81d could not be found. Nov 24 03:07:49.692984 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-20ed2e96-e997-4352-85b8-db63fc5d764c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Returning 404 to user: Instance bfde9ed7-de6c-421b-bb42-46506b2ef81d could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:07:49.693960 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-20ed2e96-e997-4352-85b8-db63fc5d764c tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d" status: 404 len: 111 microversion: 2.1 time: 0.031642 Nov 24 03:07:49.694504 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 336/639] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:49 2021] GET /compute/v2.1/servers/bfde9ed7-de6c-421b-bb42-46506b2ef81d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:07:49.702606 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d79491e5-fed4-421a-9c0b-e198fcbb34c1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:49.703173 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d79491e5-fed4-421a-9c0b-e198fcbb34c1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:49.710594 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d79491e5-fed4-421a-9c0b-e198fcbb34c1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:49.711041 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d79491e5-fed4-421a-9c0b-e198fcbb34c1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:49.711831 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d79491e5-fed4-421a-9c0b-e198fcbb34c1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:49.712262 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d79491e5-fed4-421a-9c0b-e198fcbb34c1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:49.730941 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ca10ec60-d39c-4bf7-9936-9de77b097ec7 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:49.731784 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ca10ec60-d39c-4bf7-9936-9de77b097ec7 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:49.737492 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d79491e5-fed4-421a-9c0b-e198fcbb34c1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:07:49.737797 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ca10ec60-d39c-4bf7-9936-9de77b097ec7 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:49.738282 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ca10ec60-d39c-4bf7-9936-9de77b097ec7 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:49.739183 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ca10ec60-d39c-4bf7-9936-9de77b097ec7 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:49.739183 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ca10ec60-d39c-4bf7-9936-9de77b097ec7 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:49.824953 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d79491e5-fed4-421a-9c0b-e198fcbb34c1 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 204 len: 0 microversion: 2.1 time: 0.125792 Nov 24 03:07:49.826060 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 304/640] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:07:49 2021] DELETE /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 03:07:49.836448 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2ad43e8c-3650-4430-be96-8bcbc53e8610 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:49.837161 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2ad43e8c-3650-4430-be96-8bcbc53e8610 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:49.843631 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2ad43e8c-3650-4430-be96-8bcbc53e8610 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:49.844090 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2ad43e8c-3650-4430-be96-8bcbc53e8610 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:49.844892 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2ad43e8c-3650-4430-be96-8bcbc53e8610 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:49.845332 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2ad43e8c-3650-4430-be96-8bcbc53e8610 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:49.895984 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ca10ec60-d39c-4bf7-9936-9de77b097ec7 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:49.904346 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ca10ec60-d39c-4bf7-9936-9de77b097ec7 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1446 microversion: 2.1 time: 0.177436 Nov 24 03:07:49.905232 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 337/641] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:49 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1446 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:49.923712 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-6d4205a9-dc75-4e7e-a884-0b7d3b5703e8 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:49.924608 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-6d4205a9-dc75-4e7e-a884-0b7d3b5703e8 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:49.932246 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6d4205a9-dc75-4e7e-a884-0b7d3b5703e8 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:49.933027 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6d4205a9-dc75-4e7e-a884-0b7d3b5703e8 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:49.934073 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6d4205a9-dc75-4e7e-a884-0b7d3b5703e8 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:49.935596 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6d4205a9-dc75-4e7e-a884-0b7d3b5703e8 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:50.005040 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2ad43e8c-3650-4430-be96-8bcbc53e8610 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:50.013355 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2ad43e8c-3650-4430-be96-8bcbc53e8610 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.182547 Nov 24 03:07:50.013972 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 305/642] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:49 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:50.080562 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-6d4205a9-dc75-4e7e-a884-0b7d3b5703e8 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:50.088983 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-6d4205a9-dc75-4e7e-a884-0b7d3b5703e8 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1446 microversion: 2.1 time: 0.169004 Nov 24 03:07:50.089741 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 338/643] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:49 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1446 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:50.330835 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d650f4da-cfd3-45d5-8dc6-ab6faeb65563 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:50.331446 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d650f4da-cfd3-45d5-8dc6-ab6faeb65563 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:50.338203 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d650f4da-cfd3-45d5-8dc6-ab6faeb65563 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:50.338894 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d650f4da-cfd3-45d5-8dc6-ab6faeb65563 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:50.339688 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d650f4da-cfd3-45d5-8dc6-ab6faeb65563 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:50.340147 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d650f4da-cfd3-45d5-8dc6-ab6faeb65563 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:50.575500 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d650f4da-cfd3-45d5-8dc6-ab6faeb65563 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:50.584559 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d650f4da-cfd3-45d5-8dc6-ab6faeb65563 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1757 microversion: 2.1 time: 0.257454 Nov 24 03:07:50.585186 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 306/644] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:50 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1757 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:51.031223 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5e73b3a2-d48a-4d72-bacf-c3b47643bbc3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:51.031847 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-5e73b3a2-d48a-4d72-bacf-c3b47643bbc3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:51.040629 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5e73b3a2-d48a-4d72-bacf-c3b47643bbc3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:51.043192 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5e73b3a2-d48a-4d72-bacf-c3b47643bbc3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:51.043981 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5e73b3a2-d48a-4d72-bacf-c3b47643bbc3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:51.044529 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5e73b3a2-d48a-4d72-bacf-c3b47643bbc3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:51.190772 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5e73b3a2-d48a-4d72-bacf-c3b47643bbc3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:51.198761 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-5e73b3a2-d48a-4d72-bacf-c3b47643bbc3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.171231 Nov 24 03:07:51.199354 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 339/645] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:51 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:07:51.604519 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3f20f8e5-7d18-412f-bac6-1c2b1d58bb8a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:51.605252 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3f20f8e5-7d18-412f-bac6-1c2b1d58bb8a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:51.616910 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f20f8e5-7d18-412f-bac6-1c2b1d58bb8a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:51.617729 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f20f8e5-7d18-412f-bac6-1c2b1d58bb8a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:51.619313 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f20f8e5-7d18-412f-bac6-1c2b1d58bb8a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:51.620109 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f20f8e5-7d18-412f-bac6-1c2b1d58bb8a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:51.920024 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3f20f8e5-7d18-412f-bac6-1c2b1d58bb8a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:51.928518 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3f20f8e5-7d18-412f-bac6-1c2b1d58bb8a tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1757 microversion: 2.1 time: 0.328729 Nov 24 03:07:51.929222 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 307/646] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:51 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1757 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:07:52.222163 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-1fbb85ef-2fc3-4eb9-8eb9-e3650ebb2289 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:52.225361 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-1fbb85ef-2fc3-4eb9-8eb9-e3650ebb2289 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:52.239895 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1fbb85ef-2fc3-4eb9-8eb9-e3650ebb2289 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:52.240947 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1fbb85ef-2fc3-4eb9-8eb9-e3650ebb2289 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:52.242477 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1fbb85ef-2fc3-4eb9-8eb9-e3650ebb2289 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:52.243529 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1fbb85ef-2fc3-4eb9-8eb9-e3650ebb2289 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:52.466660 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-1fbb85ef-2fc3-4eb9-8eb9-e3650ebb2289 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:52.475068 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-1fbb85ef-2fc3-4eb9-8eb9-e3650ebb2289 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.262604 Nov 24 03:07:52.479937 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 340/647] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:52 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:52.712956 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-9409575a-ece1-49ba-b896-cef959a6700e req-276b59b2-7264-4728-9d1b-4634dfdb9e4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262867ad-b362-4696-9425-81751e68d74f", "tag": "74c8f067-ea92-4a51-9064-326e74424693"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:07:52.717305 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:07:52.717305 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:07:52.730553 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-9409575a-ece1-49ba-b896-cef959a6700e req-276b59b2-7264-4728-9d1b-4634dfdb9e4b service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:52.731344 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-9409575a-ece1-49ba-b896-cef959a6700e req-276b59b2-7264-4728-9d1b-4634dfdb9e4b service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:52.753741 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-9409575a-ece1-49ba-b896-cef959a6700e req-276b59b2-7264-4728-9d1b-4634dfdb9e4b service nova] Creating event network-changed:74c8f067-ea92-4a51-9064-326e74424693 for instance 262867ad-b362-4696-9425-81751e68d74f on hv-cinder-81803 Nov 24 03:07:52.761987 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-9409575a-ece1-49ba-b896-cef959a6700e req-276b59b2-7264-4728-9d1b-4634dfdb9e4b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058426 Nov 24 03:07:52.762626 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 308/648] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:07:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:07:52.953392 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-983759b4-281d-4af7-b1ed-d6a21d33444f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:52.954727 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-983759b4-281d-4af7-b1ed-d6a21d33444f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:52.961174 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-983759b4-281d-4af7-b1ed-d6a21d33444f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:52.961961 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-983759b4-281d-4af7-b1ed-d6a21d33444f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:52.963087 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-983759b4-281d-4af7-b1ed-d6a21d33444f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:52.963435 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-983759b4-281d-4af7-b1ed-d6a21d33444f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:53.182722 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-983759b4-281d-4af7-b1ed-d6a21d33444f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:53.194415 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-983759b4-281d-4af7-b1ed-d6a21d33444f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1757 microversion: 2.1 time: 0.246435 Nov 24 03:07:53.195364 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 341/649] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:52 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1757 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:53.503638 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3c32ca86-1493-429a-b87a-cf6b0615579e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:53.504858 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3c32ca86-1493-429a-b87a-cf6b0615579e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:53.516093 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c32ca86-1493-429a-b87a-cf6b0615579e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:53.517256 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c32ca86-1493-429a-b87a-cf6b0615579e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:53.518740 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c32ca86-1493-429a-b87a-cf6b0615579e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:53.519532 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c32ca86-1493-429a-b87a-cf6b0615579e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:53.732602 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3c32ca86-1493-429a-b87a-cf6b0615579e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:53.740530 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3c32ca86-1493-429a-b87a-cf6b0615579e tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.246452 Nov 24 03:07:53.741227 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 309/650] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:53 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:54.212268 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-d5225085-3a4b-4987-b849-45a9fa209b6f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:54.212927 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-d5225085-3a4b-4987-b849-45a9fa209b6f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:54.221108 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d5225085-3a4b-4987-b849-45a9fa209b6f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:54.221534 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d5225085-3a4b-4987-b849-45a9fa209b6f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:54.222584 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d5225085-3a4b-4987-b849-45a9fa209b6f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:54.223135 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d5225085-3a4b-4987-b849-45a9fa209b6f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:54.383454 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-d5225085-3a4b-4987-b849-45a9fa209b6f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:54.394631 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-d5225085-3a4b-4987-b849-45a9fa209b6f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1757 microversion: 2.1 time: 0.185763 Nov 24 03:07:54.395964 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 342/651] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:54 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:54.757993 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a9d0e2de-e4a5-4567-b0eb-fab7406921f3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:54.758685 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a9d0e2de-e4a5-4567-b0eb-fab7406921f3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:54.765970 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a9d0e2de-e4a5-4567-b0eb-fab7406921f3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:54.766562 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a9d0e2de-e4a5-4567-b0eb-fab7406921f3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:54.767942 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a9d0e2de-e4a5-4567-b0eb-fab7406921f3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:54.768537 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a9d0e2de-e4a5-4567-b0eb-fab7406921f3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:54.950755 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a9d0e2de-e4a5-4567-b0eb-fab7406921f3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:54.959103 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a9d0e2de-e4a5-4567-b0eb-fab7406921f3 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.204821 Nov 24 03:07:54.959698 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 310/652] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:54 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:55.413706 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-20d799a9-5be6-4525-a29e-c8f6a39cb8a0 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:55.414341 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-20d799a9-5be6-4525-a29e-c8f6a39cb8a0 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:55.421321 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-20d799a9-5be6-4525-a29e-c8f6a39cb8a0 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:55.421775 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-20d799a9-5be6-4525-a29e-c8f6a39cb8a0 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:55.422614 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-20d799a9-5be6-4525-a29e-c8f6a39cb8a0 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:55.423049 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-20d799a9-5be6-4525-a29e-c8f6a39cb8a0 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:55.631527 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-20d799a9-5be6-4525-a29e-c8f6a39cb8a0 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:55.640144 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-20d799a9-5be6-4525-a29e-c8f6a39cb8a0 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1757 microversion: 2.1 time: 0.230149 Nov 24 03:07:55.640570 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 343/653] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:55 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1757 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:55.976546 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-952ab059-3214-4862-a135-135b264a1e06 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:55.977164 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-952ab059-3214-4862-a135-135b264a1e06 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:55.983855 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-952ab059-3214-4862-a135-135b264a1e06 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:55.984789 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-952ab059-3214-4862-a135-135b264a1e06 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:55.985091 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-952ab059-3214-4862-a135-135b264a1e06 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:55.985523 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-952ab059-3214-4862-a135-135b264a1e06 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:56.137357 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-952ab059-3214-4862-a135-135b264a1e06 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:56.145947 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-952ab059-3214-4862-a135-135b264a1e06 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.172967 Nov 24 03:07:56.146536 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 311/654] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:55 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:56.658317 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-25620e7b-0d25-4670-a677-d2fe53e9c8e7 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:56.658986 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-25620e7b-0d25-4670-a677-d2fe53e9c8e7 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:56.665747 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-25620e7b-0d25-4670-a677-d2fe53e9c8e7 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:56.666267 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-25620e7b-0d25-4670-a677-d2fe53e9c8e7 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:56.667164 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-25620e7b-0d25-4670-a677-d2fe53e9c8e7 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:56.667643 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-25620e7b-0d25-4670-a677-d2fe53e9c8e7 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:56.840652 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-25620e7b-0d25-4670-a677-d2fe53e9c8e7 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:56.849212 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-25620e7b-0d25-4670-a677-d2fe53e9c8e7 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1757 microversion: 2.1 time: 0.194526 Nov 24 03:07:56.849817 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 344/655] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:56 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1757 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:57.163255 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2c8a6927-6ff8-4e0d-9481-dc08795d46ee tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:57.163884 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2c8a6927-6ff8-4e0d-9481-dc08795d46ee tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:57.171226 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2c8a6927-6ff8-4e0d-9481-dc08795d46ee tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:57.171746 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2c8a6927-6ff8-4e0d-9481-dc08795d46ee tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:57.172542 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2c8a6927-6ff8-4e0d-9481-dc08795d46ee tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:57.172967 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2c8a6927-6ff8-4e0d-9481-dc08795d46ee tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:57.341335 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2c8a6927-6ff8-4e0d-9481-dc08795d46ee tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:57.350836 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2c8a6927-6ff8-4e0d-9481-dc08795d46ee tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.191340 Nov 24 03:07:57.351447 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 312/656] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:57 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:57.877244 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-3e629770-eadc-45e1-b538-c20228b1ba2c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:57.877842 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-3e629770-eadc-45e1-b538-c20228b1ba2c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:57.885039 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3e629770-eadc-45e1-b538-c20228b1ba2c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:57.885506 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3e629770-eadc-45e1-b538-c20228b1ba2c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:57.886331 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3e629770-eadc-45e1-b538-c20228b1ba2c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:57.886758 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3e629770-eadc-45e1-b538-c20228b1ba2c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:58.102388 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-3e629770-eadc-45e1-b538-c20228b1ba2c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:58.116289 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-3e629770-eadc-45e1-b538-c20228b1ba2c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1757 microversion: 2.1 time: 0.242773 Nov 24 03:07:58.117344 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 345/657] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:57 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1757 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:58.369721 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0b56443b-e6ec-4ade-b01b-22b6243f5b15 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:58.370612 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0b56443b-e6ec-4ade-b01b-22b6243f5b15 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:58.376810 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b56443b-e6ec-4ade-b01b-22b6243f5b15 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:58.377274 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b56443b-e6ec-4ade-b01b-22b6243f5b15 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:58.378126 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b56443b-e6ec-4ade-b01b-22b6243f5b15 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:58.378601 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b56443b-e6ec-4ade-b01b-22b6243f5b15 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:58.532767 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0b56443b-e6ec-4ade-b01b-22b6243f5b15 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:58.540925 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0b56443b-e6ec-4ade-b01b-22b6243f5b15 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1521 microversion: 2.1 time: 0.175049 Nov 24 03:07:58.541523 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 313/658] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:58 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:59.140658 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-384b0fe2-415c-4b2d-b085-ae75b7047d86 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:59.142387 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-384b0fe2-415c-4b2d-b085-ae75b7047d86 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:59.149348 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-384b0fe2-415c-4b2d-b085-ae75b7047d86 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:59.150269 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-384b0fe2-415c-4b2d-b085-ae75b7047d86 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:59.151355 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-384b0fe2-415c-4b2d-b085-ae75b7047d86 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:59.151906 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-384b0fe2-415c-4b2d-b085-ae75b7047d86 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:59.430761 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-384b0fe2-415c-4b2d-b085-ae75b7047d86 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:59.433476 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-b60f33ed-2c01-4b1b-95c3-9fac319e26a2 req-505d5043-baac-4268-89f5-90171abfd32c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd67a95-85a5-4669-bc7b-2d50f1716c54", "name": "network-vif-deleted", "tag": "20bfed33-5015-44fe-bee7-37407d6d4c9e"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:07:59.439021 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:07:59.439021 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:07:59.445034 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-384b0fe2-415c-4b2d-b085-ae75b7047d86 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1757 microversion: 2.1 time: 0.305867 Nov 24 03:07:59.454336 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-b60f33ed-2c01-4b1b-95c3-9fac319e26a2 req-505d5043-baac-4268-89f5-90171abfd32c service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:59.454505 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 346/659] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:59 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1757 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:07:59.454694 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-b60f33ed-2c01-4b1b-95c3-9fac319e26a2 req-505d5043-baac-4268-89f5-90171abfd32c service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:59.479544 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-b60f33ed-2c01-4b1b-95c3-9fac319e26a2 req-505d5043-baac-4268-89f5-90171abfd32c service nova] Creating event network-vif-deleted:20bfed33-5015-44fe-bee7-37407d6d4c9e for instance 6bd67a95-85a5-4669-bc7b-2d50f1716c54 on hv-cinder-81803 Nov 24 03:07:59.484975 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-b60f33ed-2c01-4b1b-95c3-9fac319e26a2 req-505d5043-baac-4268-89f5-90171abfd32c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060269 Nov 24 03:07:59.485625 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 314/660] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:07:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:07:59.562414 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-9da3c99b-1a17-4e3b-8452-8f79e2399c4d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:07:59.563659 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-9da3c99b-1a17-4e3b-8452-8f79e2399c4d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:07:59.571833 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9da3c99b-1a17-4e3b-8452-8f79e2399c4d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:59.572396 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9da3c99b-1a17-4e3b-8452-8f79e2399c4d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:59.573480 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9da3c99b-1a17-4e3b-8452-8f79e2399c4d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:59.574149 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9da3c99b-1a17-4e3b-8452-8f79e2399c4d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:59.614421 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9da3c99b-1a17-4e3b-8452-8f79e2399c4d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:07:59.615022 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9da3c99b-1a17-4e3b-8452-8f79e2399c4d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:07:59.615511 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.objects.instance [None req-9da3c99b-1a17-4e3b-8452-8f79e2399c4d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lazy-loading 'fault' on Instance uuid 6bd67a95-85a5-4669-bc7b-2d50f1716c54 {{(pid=116331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:07:59.666950 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-9da3c99b-1a17-4e3b-8452-8f79e2399c4d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1889aa91484766bf6bebe407431936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183208d9e5a24b759edb898c961eaa4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:07:59.675765 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-9da3c99b-1a17-4e3b-8452-8f79e2399c4d tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 200 len: 1311 microversion: 2.1 time: 0.120934 Nov 24 03:07:59.676501 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 347/661] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:07:59 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 1311 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:00.463168 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-172e5a9d-e117-4e69-a0a3-06c1c9805d3c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:00.463890 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-172e5a9d-e117-4e69-a0a3-06c1c9805d3c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:00.471081 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-172e5a9d-e117-4e69-a0a3-06c1c9805d3c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:00.471534 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-172e5a9d-e117-4e69-a0a3-06c1c9805d3c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:00.472336 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-172e5a9d-e117-4e69-a0a3-06c1c9805d3c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:00.473107 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-172e5a9d-e117-4e69-a0a3-06c1c9805d3c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:00.629359 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-172e5a9d-e117-4e69-a0a3-06c1c9805d3c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:00.637696 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-172e5a9d-e117-4e69-a0a3-06c1c9805d3c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1757 microversion: 2.1 time: 0.178552 Nov 24 03:08:00.638318 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 315/662] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:00 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:00.694603 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e18419a4-0397-498b-b8e1-3ccab2a12be6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:00.695211 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e18419a4-0397-498b-b8e1-3ccab2a12be6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] [instance: 6bd67a95-85a5-4669-bc7b-2d50f1716c54] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:00.702145 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e18419a4-0397-498b-b8e1-3ccab2a12be6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:00.702598 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e18419a4-0397-498b-b8e1-3ccab2a12be6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:00.703426 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e18419a4-0397-498b-b8e1-3ccab2a12be6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:00.703862 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e18419a4-0397-498b-b8e1-3ccab2a12be6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:00.719765 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-e18419a4-0397-498b-b8e1-3ccab2a12be6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] HTTP exception thrown: Instance 6bd67a95-85a5-4669-bc7b-2d50f1716c54 could not be found. Nov 24 03:08:00.720436 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e18419a4-0397-498b-b8e1-3ccab2a12be6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] Returning 404 to user: Instance 6bd67a95-85a5-4669-bc7b-2d50f1716c54 could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:08:00.721278 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e18419a4-0397-498b-b8e1-3ccab2a12be6 tempest-ServerRescueNegativeTestJSON-476033995 tempest-ServerRescueNegativeTestJSON-476033995-project] 10.222.0.52 "GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54" status: 404 len: 111 microversion: 2.1 time: 0.031410 Nov 24 03:08:00.722102 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 348/663] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:00 2021] GET /compute/v2.1/servers/6bd67a95-85a5-4669-bc7b-2d50f1716c54 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:08:01.660311 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d7de38a4-c6f3-424c-a562-4fc9e63f8f9f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:01.661350 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d7de38a4-c6f3-424c-a562-4fc9e63f8f9f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:01.669746 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d7de38a4-c6f3-424c-a562-4fc9e63f8f9f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:01.670405 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d7de38a4-c6f3-424c-a562-4fc9e63f8f9f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:01.671315 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d7de38a4-c6f3-424c-a562-4fc9e63f8f9f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:01.671851 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d7de38a4-c6f3-424c-a562-4fc9e63f8f9f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:01.929074 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d7de38a4-c6f3-424c-a562-4fc9e63f8f9f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:01.950739 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d7de38a4-c6f3-424c-a562-4fc9e63f8f9f tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1757 microversion: 2.1 time: 0.297513 Nov 24 03:08:01.956408 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 316/664] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:01 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1757 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:02.968711 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b8a30c32-7926-4742-b904-1015bd5bb614 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:02.970016 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b8a30c32-7926-4742-b904-1015bd5bb614 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:02.977968 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b8a30c32-7926-4742-b904-1015bd5bb614 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:02.978815 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b8a30c32-7926-4742-b904-1015bd5bb614 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:02.979720 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b8a30c32-7926-4742-b904-1015bd5bb614 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:02.980382 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b8a30c32-7926-4742-b904-1015bd5bb614 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:03.252254 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b8a30c32-7926-4742-b904-1015bd5bb614 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:03.267150 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b8a30c32-7926-4742-b904-1015bd5bb614 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1757 microversion: 2.1 time: 0.302104 Nov 24 03:08:03.268743 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 349/665] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:02 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1757 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:04.287787 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-40c29922-3414-418b-9f35-9f5ba85b04f6 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:04.289144 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-40c29922-3414-418b-9f35-9f5ba85b04f6 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:04.296265 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-40c29922-3414-418b-9f35-9f5ba85b04f6 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:04.296712 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-40c29922-3414-418b-9f35-9f5ba85b04f6 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:04.297508 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-40c29922-3414-418b-9f35-9f5ba85b04f6 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:04.297957 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-40c29922-3414-418b-9f35-9f5ba85b04f6 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:04.554491 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-40c29922-3414-418b-9f35-9f5ba85b04f6 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:04.565700 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-40c29922-3414-418b-9f35-9f5ba85b04f6 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1757 microversion: 2.1 time: 0.283034 Nov 24 03:08:04.566390 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 317/666] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:04 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1757 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:05.583412 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c5ba29a5-69be-4e0e-a14d-4d93d44dd282 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:05.584071 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c5ba29a5-69be-4e0e-a14d-4d93d44dd282 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:05.590303 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c5ba29a5-69be-4e0e-a14d-4d93d44dd282 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:05.590757 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c5ba29a5-69be-4e0e-a14d-4d93d44dd282 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:05.591548 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c5ba29a5-69be-4e0e-a14d-4d93d44dd282 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:05.592013 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c5ba29a5-69be-4e0e-a14d-4d93d44dd282 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:05.748714 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c5ba29a5-69be-4e0e-a14d-4d93d44dd282 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:05.757152 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c5ba29a5-69be-4e0e-a14d-4d93d44dd282 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1757 microversion: 2.1 time: 0.177645 Nov 24 03:08:05.757730 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 350/667] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:05 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:06.774803 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-13e92843-43c8-4a7e-af0d-4ae668f45dcd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:06.775374 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-13e92843-43c8-4a7e-af0d-4ae668f45dcd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:06.782695 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-13e92843-43c8-4a7e-af0d-4ae668f45dcd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:06.783144 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-13e92843-43c8-4a7e-af0d-4ae668f45dcd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:06.783946 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-13e92843-43c8-4a7e-af0d-4ae668f45dcd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:06.784380 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-13e92843-43c8-4a7e-af0d-4ae668f45dcd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:06.945538 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-13e92843-43c8-4a7e-af0d-4ae668f45dcd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:06.954774 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-13e92843-43c8-4a7e-af0d-4ae668f45dcd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1757 microversion: 2.1 time: 0.183894 Nov 24 03:08:06.955376 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 318/668] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:06 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:07.156221 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e4c52ae7-224a-4ddd-ae93-e055dfc0bd58 tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] Calling method '.version_select at 0x7f7a2ded1af0>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:07.224919 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e4c52ae7-224a-4ddd-ae93-e055dfc0bd58 tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/882d803f-b2cb-48a8-b1af-2db71a73545e" status: 200 len: 351 microversion: 2.1 time: 0.073035 Nov 24 03:08:07.226178 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 351/669] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Nov 24 03:08:07 2021] GET /compute/v2.1/os-volumes/882d803f-b2cb-48a8-b1af-2db71a73545e => generated 351 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:08:07.972812 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-78170775-5448-4d6e-a15b-41decbd3fedd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:07.973446 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-78170775-5448-4d6e-a15b-41decbd3fedd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:07.980340 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-78170775-5448-4d6e-a15b-41decbd3fedd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:07.980815 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-78170775-5448-4d6e-a15b-41decbd3fedd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:07.981613 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-78170775-5448-4d6e-a15b-41decbd3fedd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:07.982094 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-78170775-5448-4d6e-a15b-41decbd3fedd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:08.161847 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-78170775-5448-4d6e-a15b-41decbd3fedd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:08.171523 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-78170775-5448-4d6e-a15b-41decbd3fedd tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1760 microversion: 2.1 time: 0.202324 Nov 24 03:08:08.172538 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 319/670] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:07 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1760 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:08.603969 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7bd22c6a-19a5-4630-a014-9da1e53baf84 tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] Calling method '.version_select at 0x7f7a2de11430>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:08.664450 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7bd22c6a-19a5-4630-a014-9da1e53baf84 tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/06099570-9c37-4c40-b90c-eb4ba47492db" status: 200 len: 350 microversion: 2.1 time: 0.067577 Nov 24 03:08:08.664649 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 352/671] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Nov 24 03:08:08 2021] GET /compute/v2.1/os-volumes/06099570-9c37-4c40-b90c-eb4ba47492db => generated 350 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:08:10.036290 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6541b1b5-8e31-440d-9d7f-108a6459792b tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] Calling method '.version_select at 0x7f7a2de64160>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:10.087356 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6541b1b5-8e31-440d-9d7f-108a6459792b tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1cb25ca3-9aeb-46ba-b2e5-3dd6bbeeb3b6" status: 200 len: 350 microversion: 2.1 time: 0.055512 Nov 24 03:08:10.088449 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 320/672] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Nov 24 03:08:10 2021] GET /compute/v2.1/os-volumes/1cb25ca3-9aeb-46ba-b2e5-3dd6bbeeb3b6 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:08:10.101196 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-d4c3180f-3605-4587-bf8d-f1dc6ecdfc99 tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] Calling method '.version_select at 0x7f7a2dd66820>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:10.185111 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-d4c3180f-3605-4587-bf8d-f1dc6ecdfc99 tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.088907 Nov 24 03:08:10.185694 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 353/673] 10.222.0.52 () {58 vars in 1133 bytes} [Wed Nov 24 03:08:10 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:10.201424 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8f66b8cb-eda2-44c0-b07a-a08a81363862 tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] Calling method '.version_select at 0x7f7a2de84dc0>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:10.288623 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8f66b8cb-eda2-44c0-b07a-a08a81363862 tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.091558 Nov 24 03:08:10.289302 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 321/674] 10.222.0.52 () {58 vars in 1148 bytes} [Wed Nov 24 03:08:10 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:08:10.301575 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-41f815ff-3bc9-49f4-af63-503b61519d25 tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] Calling method '.version_select at 0x7f7a2dddbf70>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:10.391059 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-41f815ff-3bc9-49f4-af63-503b61519d25 tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.093425 Nov 24 03:08:10.392176 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 354/675] 10.222.0.52 () {58 vars in 1133 bytes} [Wed Nov 24 03:08:10 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:10.406952 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c0d32038-0c18-419f-8dc7-3fb2236c79fd tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] Calling method '.version_select at 0x7f7a2de76d30>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:10.490702 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c0d32038-0c18-419f-8dc7-3fb2236c79fd tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088112 Nov 24 03:08:10.491267 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 322/676] 10.222.0.52 () {58 vars in 1166 bytes} [Wed Nov 24 03:08:10 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:08:10.503890 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b872cc16-4473-4f9c-aa3e-09de36c4b865 tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] Calling method '.version_select at 0x7f7a2df74f70>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:10.607712 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b872cc16-4473-4f9c-aa3e-09de36c4b865 tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.107578 Nov 24 03:08:10.608307 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 355/677] 10.222.0.52 () {58 vars in 1169 bytes} [Wed Nov 24 03:08:10 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:08:10.621043 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-918ed16c-9f3a-41de-b9fb-62d1ef127197 tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] Calling method '.version_select at 0x7f7a2de765e0>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:10.710009 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-918ed16c-9f3a-41de-b9fb-62d1ef127197 tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.092484 Nov 24 03:08:10.710698 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 323/678] 10.222.0.52 () {58 vars in 1154 bytes} [Wed Nov 24 03:08:10 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:10.724123 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b142c74a-bab4-4b59-a90e-81db263d82ce tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] Calling method '.version_select at 0x7f7a2dd668b0>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:10.816646 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b142c74a-bab4-4b59-a90e-81db263d82ce tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.097358 Nov 24 03:08:10.817244 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 356/679] 10.222.0.52 () {58 vars in 1187 bytes} [Wed Nov 24 03:08:10 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:08:10.829858 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f03d5277-5d4d-4c37-95ac-2c7ae08ab1df tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] Calling method '.version_select at 0x7f7a2e8b80d0>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:10.913860 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f03d5277-5d4d-4c37-95ac-2c7ae08ab1df tempest-VolumesTestJSON-1152170746 tempest-VolumesTestJSON-1152170746-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088115 Nov 24 03:08:10.916701 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 324/680] 10.222.0.52 () {58 vars in 1154 bytes} [Wed Nov 24 03:08:10 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:22.733979 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ba15eff6-7108-415e-9ae3-a72babc110e0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:22.734626 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ba15eff6-7108-415e-9ae3-a72babc110e0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:22.740874 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ba15eff6-7108-415e-9ae3-a72babc110e0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:22.741306 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ba15eff6-7108-415e-9ae3-a72babc110e0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:22.742133 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ba15eff6-7108-415e-9ae3-a72babc110e0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:22.742564 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ba15eff6-7108-415e-9ae3-a72babc110e0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:22.825945 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.objects.instance [None req-ba15eff6-7108-415e-9ae3-a72babc110e0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lazy-loading 'services' on Instance uuid dd9b822e-b442-450a-acaa-df8261422f50 {{(pid=116331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:08:22.910512 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ba15eff6-7108-415e-9ae3-a72babc110e0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/os-volume_attachments/76fc869f-5bd8-4506-a993-df33bd89ce6e" status: 202 len: 0 microversion: 2.1 time: 0.179762 Nov 24 03:08:22.911319 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 357/681] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Nov 24 03:08:22 2021] DELETE /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/os-volume_attachments/76fc869f-5bd8-4506-a993-df33bd89ce6e => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:08:24.050698 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-416fea02-7e30-4f51-9873-30b840255496 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:08:24.063842 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-416fea02-7e30-4f51-9873-30b840255496 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:24.064618 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-416fea02-7e30-4f51-9873-30b840255496 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:24.093480 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-416fea02-7e30-4f51-9873-30b840255496 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Going to try to stop instance {{(pid=116330) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 24 03:08:24.147707 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-416fea02-7e30-4f51-9873-30b840255496 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 202 len: 0 microversion: 2.1 time: 0.103917 Nov 24 03:08:24.148717 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 325/682] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:08:24 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 03:08:24.159880 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b1c9e559-7dfe-4880-8969-a2936445e8c7 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:24.160857 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b1c9e559-7dfe-4880-8969-a2936445e8c7 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:24.170393 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b1c9e559-7dfe-4880-8969-a2936445e8c7 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:24.171342 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b1c9e559-7dfe-4880-8969-a2936445e8c7 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:24.172337 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b1c9e559-7dfe-4880-8969-a2936445e8c7 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:24.173388 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b1c9e559-7dfe-4880-8969-a2936445e8c7 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:24.353478 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b1c9e559-7dfe-4880-8969-a2936445e8c7 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:24.361492 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b1c9e559-7dfe-4880-8969-a2936445e8c7 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1678 microversion: 2.1 time: 0.208117 Nov 24 03:08:24.362148 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 358/683] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:24 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1678 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:24.807413 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-418316f9-e01c-4300-bfae-b150a72bc746 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:24.808483 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-418316f9-e01c-4300-bfae-b150a72bc746 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:24.815558 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-418316f9-e01c-4300-bfae-b150a72bc746 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:24.816523 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-418316f9-e01c-4300-bfae-b150a72bc746 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:24.817338 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-418316f9-e01c-4300-bfae-b150a72bc746 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:24.817979 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-418316f9-e01c-4300-bfae-b150a72bc746 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:24.853450 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-418316f9-e01c-4300-bfae-b150a72bc746 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/os-volume_attachments/cc28d9c0-c6c0-473e-b696-74a0efd054bd" status: 200 len: 194 microversion: 2.20 time: 0.050232 Nov 24 03:08:24.854113 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 326/684] 10.222.0.52 () {60 vars in 1453 bytes} [Wed Nov 24 03:08:24 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/os-volume_attachments/cc28d9c0-c6c0-473e-b696-74a0efd054bd => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 03:08:24.943963 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ab22e53a-b999-40cb-8e53-e913d05217bd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:24.944472 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ab22e53a-b999-40cb-8e53-e913d05217bd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:24.951972 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ab22e53a-b999-40cb-8e53-e913d05217bd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:24.952348 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ab22e53a-b999-40cb-8e53-e913d05217bd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:24.953422 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ab22e53a-b999-40cb-8e53-e913d05217bd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:24.954102 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ab22e53a-b999-40cb-8e53-e913d05217bd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:25.054924 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.objects.instance [None req-ab22e53a-b999-40cb-8e53-e913d05217bd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lazy-loading 'services' on Instance uuid dfaf6d4e-4188-451d-8af8-32300d13ae2d {{(pid=116331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:08:25.172991 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ab22e53a-b999-40cb-8e53-e913d05217bd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/os-volume_attachments/cc28d9c0-c6c0-473e-b696-74a0efd054bd" status: 202 len: 0 microversion: 2.20 time: 0.232837 Nov 24 03:08:25.174161 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 359/685] 10.222.0.52 () {60 vars in 1456 bytes} [Wed Nov 24 03:08:24 2021] DELETE /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/os-volume_attachments/cc28d9c0-c6c0-473e-b696-74a0efd054bd => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:08:25.193959 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-107257c6-e2d6-4aed-bee3-06ef85749bfe tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:25.199394 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-107257c6-e2d6-4aed-bee3-06ef85749bfe tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:25.246515 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-107257c6-e2d6-4aed-bee3-06ef85749bfe tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:25.247715 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-107257c6-e2d6-4aed-bee3-06ef85749bfe tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:25.249481 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-107257c6-e2d6-4aed-bee3-06ef85749bfe tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:25.251373 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-107257c6-e2d6-4aed-bee3-06ef85749bfe tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:25.338097 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-107257c6-e2d6-4aed-bee3-06ef85749bfe tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.155324 Nov 24 03:08:25.344060 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 327/686] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Nov 24 03:08:25 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:08:25.383521 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-1924a4db-1582-46c6-94eb-5d456e5846aa tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:25.384789 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-1924a4db-1582-46c6-94eb-5d456e5846aa tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:25.396061 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1924a4db-1582-46c6-94eb-5d456e5846aa tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:25.396552 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1924a4db-1582-46c6-94eb-5d456e5846aa tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:25.397385 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1924a4db-1582-46c6-94eb-5d456e5846aa tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:25.397882 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1924a4db-1582-46c6-94eb-5d456e5846aa tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:25.604650 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-1924a4db-1582-46c6-94eb-5d456e5846aa tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:25.614507 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-1924a4db-1582-46c6-94eb-5d456e5846aa tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1678 microversion: 2.1 time: 0.237460 Nov 24 03:08:25.615103 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 360/687] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:25 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:26.354568 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-da27c525-a81f-4907-a8df-060021c19d24 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:26.355614 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-da27c525-a81f-4907-a8df-060021c19d24 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:26.364191 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-da27c525-a81f-4907-a8df-060021c19d24 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:26.364634 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-da27c525-a81f-4907-a8df-060021c19d24 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:26.365431 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-da27c525-a81f-4907-a8df-060021c19d24 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:26.365859 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-da27c525-a81f-4907-a8df-060021c19d24 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:26.402530 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-da27c525-a81f-4907-a8df-060021c19d24 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052628 Nov 24 03:08:26.403432 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 328/688] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Nov 24 03:08:26 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:26.465842 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-45fc4707-1b35-4fcd-9be7-ea7726ac1435 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:26.466488 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-45fc4707-1b35-4fcd-9be7-ea7726ac1435 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:26.474467 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-45fc4707-1b35-4fcd-9be7-ea7726ac1435 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:26.475262 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-45fc4707-1b35-4fcd-9be7-ea7726ac1435 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:26.476669 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-45fc4707-1b35-4fcd-9be7-ea7726ac1435 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:26.477475 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-45fc4707-1b35-4fcd-9be7-ea7726ac1435 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:26.507037 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-45fc4707-1b35-4fcd-9be7-ea7726ac1435 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Going to try to terminate instance {{(pid=116331) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:08:26.642391 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6891b02c-3bf0-401d-8432-eb6e89d67aad tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:26.643333 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-45fc4707-1b35-4fcd-9be7-ea7726ac1435 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 204 len: 0 microversion: 2.20 time: 0.177599 Nov 24 03:08:26.645937 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 361/689] 10.222.0.52 () {60 vars in 1279 bytes} [Wed Nov 24 03:08:26 2021] DELETE /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 24 03:08:26.650148 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6891b02c-3bf0-401d-8432-eb6e89d67aad tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:26.662259 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e06d4645-f88d-41b6-b2a8-fe5d688e034d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:26.663950 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e06d4645-f88d-41b6-b2a8-fe5d688e034d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:26.667001 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6891b02c-3bf0-401d-8432-eb6e89d67aad tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:26.668352 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6891b02c-3bf0-401d-8432-eb6e89d67aad tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:26.670098 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6891b02c-3bf0-401d-8432-eb6e89d67aad tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:26.671337 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6891b02c-3bf0-401d-8432-eb6e89d67aad tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:26.677827 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e06d4645-f88d-41b6-b2a8-fe5d688e034d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:26.679049 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e06d4645-f88d-41b6-b2a8-fe5d688e034d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:26.683219 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e06d4645-f88d-41b6-b2a8-fe5d688e034d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:26.684282 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e06d4645-f88d-41b6-b2a8-fe5d688e034d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:26.972004 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e06d4645-f88d-41b6-b2a8-fe5d688e034d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:26.983464 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e06d4645-f88d-41b6-b2a8-fe5d688e034d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:26.985021 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e06d4645-f88d-41b6-b2a8-fe5d688e034d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:26.987156 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e06d4645-f88d-41b6-b2a8-fe5d688e034d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.334496 Nov 24 03:08:26.987796 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 362/690] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:08:26 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:08:27.012636 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6891b02c-3bf0-401d-8432-eb6e89d67aad tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:27.029611 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6891b02c-3bf0-401d-8432-eb6e89d67aad tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1678 microversion: 2.1 time: 0.398611 Nov 24 03:08:27.031120 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 329/691] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:26 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1678 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:08:28.017333 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-66a04743-fbbd-407d-9496-5b70d9b0ec0c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:28.017962 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-66a04743-fbbd-407d-9496-5b70d9b0ec0c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:28.025042 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-66a04743-fbbd-407d-9496-5b70d9b0ec0c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:28.025487 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-66a04743-fbbd-407d-9496-5b70d9b0ec0c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:28.026314 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-66a04743-fbbd-407d-9496-5b70d9b0ec0c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:28.026751 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-66a04743-fbbd-407d-9496-5b70d9b0ec0c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:28.053831 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f1933946-1dec-4902-bd34-afea728c5c35 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:28.054500 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f1933946-1dec-4902-bd34-afea728c5c35 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:28.062205 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1933946-1dec-4902-bd34-afea728c5c35 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:28.062634 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1933946-1dec-4902-bd34-afea728c5c35 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:28.063467 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1933946-1dec-4902-bd34-afea728c5c35 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:28.063885 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1933946-1dec-4902-bd34-afea728c5c35 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:28.179409 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-66a04743-fbbd-407d-9496-5b70d9b0ec0c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:28.191084 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-66a04743-fbbd-407d-9496-5b70d9b0ec0c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:28.194285 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-66a04743-fbbd-407d-9496-5b70d9b0ec0c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:28.196449 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-66a04743-fbbd-407d-9496-5b70d9b0ec0c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.183178 Nov 24 03:08:28.197420 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 363/692] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:08:28 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:08:28.234049 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f1933946-1dec-4902-bd34-afea728c5c35 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:28.244978 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f1933946-1dec-4902-bd34-afea728c5c35 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1678 microversion: 2.1 time: 0.195038 Nov 24 03:08:28.246967 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 330/693] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:28 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1678 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:29.220573 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ff7e4542-ce5b-451c-be98-2dbd2ef8ab60 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:29.222265 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ff7e4542-ce5b-451c-be98-2dbd2ef8ab60 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:29.235082 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ff7e4542-ce5b-451c-be98-2dbd2ef8ab60 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:29.236016 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ff7e4542-ce5b-451c-be98-2dbd2ef8ab60 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:29.237825 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ff7e4542-ce5b-451c-be98-2dbd2ef8ab60 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:29.238762 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ff7e4542-ce5b-451c-be98-2dbd2ef8ab60 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:29.266354 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c3fb17a2-d3ba-4244-82d4-f98813caefdb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:29.268058 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c3fb17a2-d3ba-4244-82d4-f98813caefdb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:29.281141 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c3fb17a2-d3ba-4244-82d4-f98813caefdb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:29.282153 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c3fb17a2-d3ba-4244-82d4-f98813caefdb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:29.284107 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c3fb17a2-d3ba-4244-82d4-f98813caefdb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:29.286269 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c3fb17a2-d3ba-4244-82d4-f98813caefdb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:29.469636 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c3fb17a2-d3ba-4244-82d4-f98813caefdb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:29.479384 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c3fb17a2-d3ba-4244-82d4-f98813caefdb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1678 microversion: 2.1 time: 0.220118 Nov 24 03:08:29.480406 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 331/694] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:29 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1678 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:29.700255 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ff7e4542-ce5b-451c-be98-2dbd2ef8ab60 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:29.719403 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ff7e4542-ce5b-451c-be98-2dbd2ef8ab60 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:29.721623 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ff7e4542-ce5b-451c-be98-2dbd2ef8ab60 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:29.723406 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ff7e4542-ce5b-451c-be98-2dbd2ef8ab60 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 200 len: 1724 microversion: 2.20 time: 0.510521 Nov 24 03:08:29.724104 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 364/695] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:08:29 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 1724 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:08:29.961642 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-71abaf1a-d981-4055-82bb-97874d97ab73 req-9229a000-d315-4014-be55-43729b024275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfaf6d4e-4188-451d-8af8-32300d13ae2d", "name": "network-vif-deleted", "tag": "521a966d-715d-42d8-a2e3-077f7788aac2"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:08:29.963595 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:08:29.963595 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:08:29.972186 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-71abaf1a-d981-4055-82bb-97874d97ab73 req-9229a000-d315-4014-be55-43729b024275 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:29.973032 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-71abaf1a-d981-4055-82bb-97874d97ab73 req-9229a000-d315-4014-be55-43729b024275 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:29.997176 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-71abaf1a-d981-4055-82bb-97874d97ab73 req-9229a000-d315-4014-be55-43729b024275 service nova] Creating event network-vif-deleted:521a966d-715d-42d8-a2e3-077f7788aac2 for instance dfaf6d4e-4188-451d-8af8-32300d13ae2d on hv-cinder-81803 Nov 24 03:08:30.009393 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-71abaf1a-d981-4055-82bb-97874d97ab73 req-9229a000-d315-4014-be55-43729b024275 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052790 Nov 24 03:08:30.010210 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 332/696] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:08:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:08:30.497963 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b9b5930f-ace8-4e20-b320-706ade70f807 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:30.499458 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b9b5930f-ace8-4e20-b320-706ade70f807 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:30.520928 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b9b5930f-ace8-4e20-b320-706ade70f807 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:30.521401 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b9b5930f-ace8-4e20-b320-706ade70f807 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:30.522405 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b9b5930f-ace8-4e20-b320-706ade70f807 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:30.523138 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b9b5930f-ace8-4e20-b320-706ade70f807 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:30.747130 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-034a9c05-f5e0-4ae7-ad2a-3cb193af2c58 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:30.758479 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-034a9c05-f5e0-4ae7-ad2a-3cb193af2c58 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:30.769508 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-034a9c05-f5e0-4ae7-ad2a-3cb193af2c58 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:30.771668 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-034a9c05-f5e0-4ae7-ad2a-3cb193af2c58 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:30.772843 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-034a9c05-f5e0-4ae7-ad2a-3cb193af2c58 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:30.773499 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-034a9c05-f5e0-4ae7-ad2a-3cb193af2c58 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:30.790117 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-034a9c05-f5e0-4ae7-ad2a-3cb193af2c58 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] HTTP exception thrown: Instance dfaf6d4e-4188-451d-8af8-32300d13ae2d could not be found. Nov 24 03:08:30.790733 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-034a9c05-f5e0-4ae7-ad2a-3cb193af2c58 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Returning 404 to user: Instance dfaf6d4e-4188-451d-8af8-32300d13ae2d could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:08:30.791843 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-034a9c05-f5e0-4ae7-ad2a-3cb193af2c58 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 404 len: 111 microversion: 2.20 time: 0.049137 Nov 24 03:08:30.792626 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 333/697] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:08:30 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 24 03:08:30.805167 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8560db26-9d36-4ccf-893e-5db99ad92b17 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '.version_select at 0x7f7a2df060d0>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:30.821321 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b9b5930f-ace8-4e20-b320-706ade70f807 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:30.830401 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b9b5930f-ace8-4e20-b320-706ade70f807 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1678 microversion: 2.1 time: 0.336660 Nov 24 03:08:30.832160 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 365/698] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:30 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1678 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:30.856277 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8560db26-9d36-4ccf-893e-5db99ad92b17 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1540762650" status: 204 len: 0 microversion: 2.20 time: 0.054859 Nov 24 03:08:30.857389 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 334/699] 10.222.0.52 () {60 vars in 1261 bytes} [Wed Nov 24 03:08:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1540762650 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 24 03:08:31.762035 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-857e8235-f46d-4f6e-a592-9b786bbe51f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'create', calling method: .version_select at 0x7f7a2de9b670>, body: {"keypair": {"name": "tempest-keypair-295997511"}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:08:31.789308 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-857e8235-f46d-4f6e-a592-9b786bbe51f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Getting quotas for project 1d1fc30b25794d87bec45177a9dcfb88. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:08:31.796809 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-857e8235-f46d-4f6e-a592-9b786bbe51f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Getting quotas for user 1bbe87944f9c4cd292ec856f6ce7ccd7 and project 1d1fc30b25794d87bec45177a9dcfb88. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:08:31.848796 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ffd4c6fc-1941-40d6-9e74-b3776a649598 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:31.850617 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ffd4c6fc-1941-40d6-9e74-b3776a649598 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:31.858559 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ffd4c6fc-1941-40d6-9e74-b3776a649598 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:31.859395 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ffd4c6fc-1941-40d6-9e74-b3776a649598 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:31.860931 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ffd4c6fc-1941-40d6-9e74-b3776a649598 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:31.861702 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ffd4c6fc-1941-40d6-9e74-b3776a649598 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:32.066643 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ffd4c6fc-1941-40d6-9e74-b3776a649598 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:32.083354 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ffd4c6fc-1941-40d6-9e74-b3776a649598 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1678 microversion: 2.1 time: 0.238636 Nov 24 03:08:32.084700 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 335/700] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:31 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:32.176522 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-857e8235-f46d-4f6e-a592-9b786bbe51f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Getting quotas for project 1d1fc30b25794d87bec45177a9dcfb88. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:08:32.182484 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-857e8235-f46d-4f6e-a592-9b786bbe51f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Getting quotas for user 1bbe87944f9c4cd292ec856f6ce7ccd7 and project 1d1fc30b25794d87bec45177a9dcfb88. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:08:32.203938 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-857e8235-f46d-4f6e-a592-9b786bbe51f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.446063 Nov 24 03:08:32.206062 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 366/701] 10.222.0.52 () {62 vars in 1198 bytes} [Wed Nov 24 03:08:31 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 450 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 24 03:08:33.109651 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5492c00a-cf8d-42f5-86d3-e2bb13b62f47 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:33.110957 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5492c00a-cf8d-42f5-86d3-e2bb13b62f47 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:33.120470 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5492c00a-cf8d-42f5-86d3-e2bb13b62f47 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:33.121233 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5492c00a-cf8d-42f5-86d3-e2bb13b62f47 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:33.122343 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5492c00a-cf8d-42f5-86d3-e2bb13b62f47 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:33.123056 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5492c00a-cf8d-42f5-86d3-e2bb13b62f47 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:33.408913 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5492c00a-cf8d-42f5-86d3-e2bb13b62f47 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:33.419197 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5492c00a-cf8d-42f5-86d3-e2bb13b62f47 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1678 microversion: 2.1 time: 0.314259 Nov 24 03:08:33.434480 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 336/702] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:33 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1678 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:34.029985 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2b669c90-8aaa-4901-8876-7f288faf05bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-262558665", "imageRef": "04860a4a-47c3-4532-865d-be6c9c493af7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "66c8762d-888d-42b7-8906-192e168df98c"}], "security_groups": [{"name": "tempest-securitygroup--1906695534"}], "key_name": "tempest-keypair-295997511", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:08:34.202853 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.network.neutron [None req-2b669c90-8aaa-4901-8876-7f288faf05bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] validate_networks() for [('66c8762d-888d-42b7-8906-192e168df98c', None, None, None, None, None)] {{(pid=116331) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:08:34.452876 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-113f2d09-343c-4ede-9dce-e4af32f05df0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:34.454225 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-113f2d09-343c-4ede-9dce-e4af32f05df0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:34.466738 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-113f2d09-343c-4ede-9dce-e4af32f05df0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:34.467531 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-113f2d09-343c-4ede-9dce-e4af32f05df0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:34.469277 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-113f2d09-343c-4ede-9dce-e4af32f05df0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:34.470173 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-113f2d09-343c-4ede-9dce-e4af32f05df0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:34.683721 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-113f2d09-343c-4ede-9dce-e4af32f05df0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:34.698870 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-113f2d09-343c-4ede-9dce-e4af32f05df0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1678 microversion: 2.1 time: 0.252739 Nov 24 03:08:34.714400 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 337/703] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:34 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1678 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:34.781682 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-2b669c90-8aaa-4901-8876-7f288faf05bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Flavor limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:08:34.782681 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-2b669c90-8aaa-4901-8876-7f288faf05bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Image limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:08:34.783602 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-2b669c90-8aaa-4901-8876-7f288faf05bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Flavor pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:08:34.784355 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-2b669c90-8aaa-4901-8876-7f288faf05bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Image pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:08:34.785281 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-2b669c90-8aaa-4901-8876-7f288faf05bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:08:34.802134 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2b669c90-8aaa-4901-8876-7f288faf05bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:34.802903 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2b669c90-8aaa-4901-8876-7f288faf05bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:34.804370 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2b669c90-8aaa-4901-8876-7f288faf05bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:34.805100 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2b669c90-8aaa-4901-8876-7f288faf05bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:34.836531 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-2b669c90-8aaa-4901-8876-7f288faf05bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Getting quotas for project 1d1fc30b25794d87bec45177a9dcfb88. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:08:34.844096 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-2b669c90-8aaa-4901-8876-7f288faf05bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Getting quotas for user 1bbe87944f9c4cd292ec856f6ce7ccd7 and project 1d1fc30b25794d87bec45177a9dcfb88. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:08:34.864734 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2b669c90-8aaa-4901-8876-7f288faf05bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Going to run 1 instances... {{(pid=116331) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:08:34.869356 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2b669c90-8aaa-4901-8876-7f288faf05bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04860a4a-47c3-4532-865d-be6c9c493af7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:08:34.945201 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2b669c90-8aaa-4901-8876-7f288faf05bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.924306 Nov 24 03:08:34.946602 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 367/704] 10.222.0.52 () {62 vars in 1187 bytes} [Wed Nov 24 03:08:34 2021] POST /compute/v2.1/servers => generated 402 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 24 03:08:34.963605 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9a689207-07b9-4f5d-91a5-54d3e3246e28 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:34.964712 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9a689207-07b9-4f5d-91a5-54d3e3246e28 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:35.036190 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9a689207-07b9-4f5d-91a5-54d3e3246e28 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:35.043896 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9a689207-07b9-4f5d-91a5-54d3e3246e28 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:35.045399 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9a689207-07b9-4f5d-91a5-54d3e3246e28 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:35.047311 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9a689207-07b9-4f5d-91a5-54d3e3246e28 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1280 microversion: 2.20 time: 0.090883 Nov 24 03:08:35.047981 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 338/705] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:08:34 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1280 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:08:35.730889 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-433c42e3-2b64-4984-bd86-934826c2de72 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:35.731989 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-433c42e3-2b64-4984-bd86-934826c2de72 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:35.744441 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-433c42e3-2b64-4984-bd86-934826c2de72 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:35.745289 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-433c42e3-2b64-4984-bd86-934826c2de72 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:35.747734 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-433c42e3-2b64-4984-bd86-934826c2de72 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:35.751861 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-433c42e3-2b64-4984-bd86-934826c2de72 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:35.954518 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-433c42e3-2b64-4984-bd86-934826c2de72 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:35.962349 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-433c42e3-2b64-4984-bd86-934826c2de72 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1655 microversion: 2.1 time: 0.239820 Nov 24 03:08:35.962957 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 368/706] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:35 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1655 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:35.982333 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-35b58731-a959-48b9-bf5b-d67c23140bcb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:08:35.991692 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-35b58731-a959-48b9-bf5b-d67c23140bcb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:35.992202 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-35b58731-a959-48b9-bf5b-d67c23140bcb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:36.023091 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-35b58731-a959-48b9-bf5b-d67c23140bcb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Going to try to start instance {{(pid=116330) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 24 03:08:36.070804 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7543b117-ed8f-456f-a628-333d13da3eb7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:36.072207 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-7543b117-ed8f-456f-a628-333d13da3eb7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:36.077373 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-35b58731-a959-48b9-bf5b-d67c23140bcb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action" status: 202 len: 0 microversion: 2.1 time: 0.100698 Nov 24 03:08:36.082058 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 339/707] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:08:35 2021] POST /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:08:36.092335 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-241ea5ce-ae6d-4211-aba8-52f94115b454 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:36.093639 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-241ea5ce-ae6d-4211-aba8-52f94115b454 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:36.099288 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7543b117-ed8f-456f-a628-333d13da3eb7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:36.099748 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7543b117-ed8f-456f-a628-333d13da3eb7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:36.100577 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7543b117-ed8f-456f-a628-333d13da3eb7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:36.101015 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7543b117-ed8f-456f-a628-333d13da3eb7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:36.106805 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-241ea5ce-ae6d-4211-aba8-52f94115b454 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:36.107257 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-241ea5ce-ae6d-4211-aba8-52f94115b454 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:36.108066 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-241ea5ce-ae6d-4211-aba8-52f94115b454 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:36.108506 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-241ea5ce-ae6d-4211-aba8-52f94115b454 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:36.235413 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7543b117-ed8f-456f-a628-333d13da3eb7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:36.249997 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7543b117-ed8f-456f-a628-333d13da3eb7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:36.253945 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7543b117-ed8f-456f-a628-333d13da3eb7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:36.255257 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7543b117-ed8f-456f-a628-333d13da3eb7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1332 microversion: 2.20 time: 0.192286 Nov 24 03:08:36.256604 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 369/708] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:08:36 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1332 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:08:36.327976 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-241ea5ce-ae6d-4211-aba8-52f94115b454 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:36.340617 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-241ea5ce-ae6d-4211-aba8-52f94115b454 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1664 microversion: 2.1 time: 0.255597 Nov 24 03:08:36.341215 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 340/709] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:36 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1664 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:37.273874 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7f4bf8be-cf18-422a-8703-1b28b2476b39 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:37.274788 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-7f4bf8be-cf18-422a-8703-1b28b2476b39 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:37.281988 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7f4bf8be-cf18-422a-8703-1b28b2476b39 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:37.282719 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7f4bf8be-cf18-422a-8703-1b28b2476b39 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:37.283734 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7f4bf8be-cf18-422a-8703-1b28b2476b39 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:37.284441 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7f4bf8be-cf18-422a-8703-1b28b2476b39 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:37.381577 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d710de8f-7753-4931-beb6-d916b084bd14 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:37.382370 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d710de8f-7753-4931-beb6-d916b084bd14 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:37.405954 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d710de8f-7753-4931-beb6-d916b084bd14 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:37.407592 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d710de8f-7753-4931-beb6-d916b084bd14 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:37.410249 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d710de8f-7753-4931-beb6-d916b084bd14 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:37.413241 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d710de8f-7753-4931-beb6-d916b084bd14 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:37.636200 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7f4bf8be-cf18-422a-8703-1b28b2476b39 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:37.645894 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7f4bf8be-cf18-422a-8703-1b28b2476b39 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:37.647951 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7f4bf8be-cf18-422a-8703-1b28b2476b39 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:37.649361 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7f4bf8be-cf18-422a-8703-1b28b2476b39 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1406 microversion: 2.20 time: 0.379511 Nov 24 03:08:37.650504 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 370/710] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:08:37 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1406 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:08:37.668370 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d710de8f-7753-4931-beb6-d916b084bd14 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:37.677391 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d710de8f-7753-4931-beb6-d916b084bd14 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1664 microversion: 2.1 time: 0.313570 Nov 24 03:08:37.678052 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 341/711] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:37 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1664 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:38.263783 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-321c43b8-d481-4a4b-af43-4149d51ae11c req-d0c6aafe-76c9-49b7-a0e1-7d9364ef03af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c38b798-2640-427f-915e-9a40f83e3b6e", "tag": "2e14e194-347c-4bad-a3ce-d09d56be7ce1"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:08:38.265503 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:08:38.265503 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:08:38.281843 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-321c43b8-d481-4a4b-af43-4149d51ae11c req-d0c6aafe-76c9-49b7-a0e1-7d9364ef03af service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:38.282737 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-321c43b8-d481-4a4b-af43-4149d51ae11c req-d0c6aafe-76c9-49b7-a0e1-7d9364ef03af service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:38.295535 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-321c43b8-d481-4a4b-af43-4149d51ae11c req-d0c6aafe-76c9-49b7-a0e1-7d9364ef03af service nova] Creating event network-changed:2e14e194-347c-4bad-a3ce-d09d56be7ce1 for instance 5c38b798-2640-427f-915e-9a40f83e3b6e on hv-cinder-81803 Nov 24 03:08:38.309182 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-321c43b8-d481-4a4b-af43-4149d51ae11c req-d0c6aafe-76c9-49b7-a0e1-7d9364ef03af service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048743 Nov 24 03:08:38.311451 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 371/712] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:08:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:08:38.680012 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ff9d5112-9e39-4e91-adb3-e9c64ad2a27f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:38.681218 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ff9d5112-9e39-4e91-adb3-e9c64ad2a27f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:38.688136 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff9d5112-9e39-4e91-adb3-e9c64ad2a27f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:38.688519 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff9d5112-9e39-4e91-adb3-e9c64ad2a27f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:38.689320 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff9d5112-9e39-4e91-adb3-e9c64ad2a27f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:38.689320 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff9d5112-9e39-4e91-adb3-e9c64ad2a27f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:38.696443 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-be469397-0fc6-4b81-a990-54898b2021ca tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:38.697136 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-be469397-0fc6-4b81-a990-54898b2021ca tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:38.707553 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-be469397-0fc6-4b81-a990-54898b2021ca tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:38.708378 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-be469397-0fc6-4b81-a990-54898b2021ca tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:38.709352 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-be469397-0fc6-4b81-a990-54898b2021ca tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:38.710226 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-be469397-0fc6-4b81-a990-54898b2021ca tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:38.874075 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ff9d5112-9e39-4e91-adb3-e9c64ad2a27f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:38.882888 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ff9d5112-9e39-4e91-adb3-e9c64ad2a27f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:38.884513 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ff9d5112-9e39-4e91-adb3-e9c64ad2a27f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:38.885751 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ff9d5112-9e39-4e91-adb3-e9c64ad2a27f tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1406 microversion: 2.20 time: 0.220958 Nov 24 03:08:38.886415 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 342/713] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:08:38 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:08:39.074335 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-be469397-0fc6-4b81-a990-54898b2021ca tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:39.086150 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-be469397-0fc6-4b81-a990-54898b2021ca tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1668 microversion: 2.1 time: 0.393384 Nov 24 03:08:39.087397 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 372/714] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:38 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1668 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:39.909340 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-619edd8f-516d-44b8-b31f-79a0ee12081a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:39.911253 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-619edd8f-516d-44b8-b31f-79a0ee12081a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:39.929352 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-619edd8f-516d-44b8-b31f-79a0ee12081a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:39.930917 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-619edd8f-516d-44b8-b31f-79a0ee12081a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:39.933254 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-619edd8f-516d-44b8-b31f-79a0ee12081a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:39.934452 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-619edd8f-516d-44b8-b31f-79a0ee12081a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:40.174155 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-619edd8f-516d-44b8-b31f-79a0ee12081a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:40.193025 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-619edd8f-516d-44b8-b31f-79a0ee12081a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:40.196183 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-619edd8f-516d-44b8-b31f-79a0ee12081a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:40.198010 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-619edd8f-516d-44b8-b31f-79a0ee12081a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1406 microversion: 2.20 time: 0.295818 Nov 24 03:08:40.199080 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 343/715] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:08:39 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1406 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:08:41.222432 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-d8112056-c739-4dd7-af04-96fde012af9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:41.222432 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-d8112056-c739-4dd7-af04-96fde012af9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:41.229485 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d8112056-c739-4dd7-af04-96fde012af9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:41.230746 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d8112056-c739-4dd7-af04-96fde012af9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:41.231462 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d8112056-c739-4dd7-af04-96fde012af9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:41.231901 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d8112056-c739-4dd7-af04-96fde012af9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:41.381952 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-d8112056-c739-4dd7-af04-96fde012af9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:41.391226 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-d8112056-c739-4dd7-af04-96fde012af9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:41.393195 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-d8112056-c739-4dd7-af04-96fde012af9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:41.394911 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-d8112056-c739-4dd7-af04-96fde012af9e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1406 microversion: 2.20 time: 0.179787 Nov 24 03:08:41.395552 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 373/716] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:08:41 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:08:42.413181 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2cf38c9a-4d16-4c58-b4c7-8766b850e063 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:42.414064 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2cf38c9a-4d16-4c58-b4c7-8766b850e063 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:42.421485 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2cf38c9a-4d16-4c58-b4c7-8766b850e063 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:42.422073 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2cf38c9a-4d16-4c58-b4c7-8766b850e063 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:42.422973 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2cf38c9a-4d16-4c58-b4c7-8766b850e063 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:42.423484 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2cf38c9a-4d16-4c58-b4c7-8766b850e063 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:42.693108 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2cf38c9a-4d16-4c58-b4c7-8766b850e063 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:42.701719 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2cf38c9a-4d16-4c58-b4c7-8766b850e063 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:42.703449 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2cf38c9a-4d16-4c58-b4c7-8766b850e063 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:42.704539 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2cf38c9a-4d16-4c58-b4c7-8766b850e063 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1406 microversion: 2.20 time: 0.295619 Nov 24 03:08:42.705115 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 344/717] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:08:42 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:08:43.724759 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0ce3d9d0-61c4-41f8-bbf9-9437184275ac tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:43.725387 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0ce3d9d0-61c4-41f8-bbf9-9437184275ac tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:43.732736 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0ce3d9d0-61c4-41f8-bbf9-9437184275ac tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:43.733188 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0ce3d9d0-61c4-41f8-bbf9-9437184275ac tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:43.734023 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0ce3d9d0-61c4-41f8-bbf9-9437184275ac tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:43.734466 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0ce3d9d0-61c4-41f8-bbf9-9437184275ac tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:43.912659 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0ce3d9d0-61c4-41f8-bbf9-9437184275ac tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:43.927399 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0ce3d9d0-61c4-41f8-bbf9-9437184275ac tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:43.930055 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0ce3d9d0-61c4-41f8-bbf9-9437184275ac tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:43.932201 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0ce3d9d0-61c4-41f8-bbf9-9437184275ac tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1406 microversion: 2.20 time: 0.212151 Nov 24 03:08:43.933149 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 374/718] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:08:43 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:08:44.954666 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-72dcfe5d-94ac-4a4b-9c4d-a1ba88c6a7bd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:44.955259 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-72dcfe5d-94ac-4a4b-9c4d-a1ba88c6a7bd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:44.963013 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-72dcfe5d-94ac-4a4b-9c4d-a1ba88c6a7bd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:44.963453 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-72dcfe5d-94ac-4a4b-9c4d-a1ba88c6a7bd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:44.964500 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-72dcfe5d-94ac-4a4b-9c4d-a1ba88c6a7bd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:44.964940 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-72dcfe5d-94ac-4a4b-9c4d-a1ba88c6a7bd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:45.212944 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-72dcfe5d-94ac-4a4b-9c4d-a1ba88c6a7bd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:45.230850 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-72dcfe5d-94ac-4a4b-9c4d-a1ba88c6a7bd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:45.237214 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-72dcfe5d-94ac-4a4b-9c4d-a1ba88c6a7bd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:45.240136 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-72dcfe5d-94ac-4a4b-9c4d-a1ba88c6a7bd tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1406 microversion: 2.20 time: 0.289069 Nov 24 03:08:45.242712 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 345/719] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:08:44 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:08:46.269825 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-3921a10e-1f35-4b1e-ab97-66bc0f7710e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:46.273459 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-3921a10e-1f35-4b1e-ab97-66bc0f7710e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:46.277208 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3921a10e-1f35-4b1e-ab97-66bc0f7710e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:46.277667 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3921a10e-1f35-4b1e-ab97-66bc0f7710e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:46.278552 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3921a10e-1f35-4b1e-ab97-66bc0f7710e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:46.278939 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3921a10e-1f35-4b1e-ab97-66bc0f7710e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:46.659040 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-3921a10e-1f35-4b1e-ab97-66bc0f7710e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:46.667484 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-3921a10e-1f35-4b1e-ab97-66bc0f7710e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:46.669113 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-3921a10e-1f35-4b1e-ab97-66bc0f7710e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:46.670305 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-3921a10e-1f35-4b1e-ab97-66bc0f7710e0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1406 microversion: 2.20 time: 0.405406 Nov 24 03:08:46.670855 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 375/720] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:08:46 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:08:47.035460 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-2bdf2d02-4f05-4dc8-9fd9-c5893bee0153 req-1c22ad5c-2175-44a5-a6ba-3ea597fa9680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c38b798-2640-427f-915e-9a40f83e3b6e", "name": "network-vif-plugged", "status": "completed", "tag": "2e14e194-347c-4bad-a3ce-d09d56be7ce1"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:08:47.037946 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:08:47.037946 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:08:47.045857 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-2bdf2d02-4f05-4dc8-9fd9-c5893bee0153 req-1c22ad5c-2175-44a5-a6ba-3ea597fa9680 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:47.046919 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-2bdf2d02-4f05-4dc8-9fd9-c5893bee0153 req-1c22ad5c-2175-44a5-a6ba-3ea597fa9680 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:47.063182 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-2bdf2d02-4f05-4dc8-9fd9-c5893bee0153 req-1c22ad5c-2175-44a5-a6ba-3ea597fa9680 service nova] Creating event network-vif-plugged:2e14e194-347c-4bad-a3ce-d09d56be7ce1 for instance 5c38b798-2640-427f-915e-9a40f83e3b6e on hv-cinder-81803 Nov 24 03:08:47.069512 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-2bdf2d02-4f05-4dc8-9fd9-c5893bee0153 req-1c22ad5c-2175-44a5-a6ba-3ea597fa9680 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038197 Nov 24 03:08:47.070634 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 346/721] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:08:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:08:47.689418 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-64c3aa55-436a-468a-910b-9fa89f3f57c7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:47.690232 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-64c3aa55-436a-468a-910b-9fa89f3f57c7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:47.697036 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-64c3aa55-436a-468a-910b-9fa89f3f57c7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:47.697516 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-64c3aa55-436a-468a-910b-9fa89f3f57c7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:47.698338 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-64c3aa55-436a-468a-910b-9fa89f3f57c7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:47.698764 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-64c3aa55-436a-468a-910b-9fa89f3f57c7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:47.824048 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-71bcc105-2fe5-4fc2-8955-7c393d692ec9 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1375300103"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:08:47.825393 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-71bcc105-2fe5-4fc2-8955-7c393d692ec9 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:47.832165 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-71bcc105-2fe5-4fc2-8955-7c393d692ec9 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:47.832786 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-71bcc105-2fe5-4fc2-8955-7c393d692ec9 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:47.833416 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-71bcc105-2fe5-4fc2-8955-7c393d692ec9 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:47.833846 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-71bcc105-2fe5-4fc2-8955-7c393d692ec9 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:47.858942 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-64c3aa55-436a-468a-910b-9fa89f3f57c7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:47.875042 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-64c3aa55-436a-468a-910b-9fa89f3f57c7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:47.878235 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-64c3aa55-436a-468a-910b-9fa89f3f57c7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:47.880383 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-64c3aa55-436a-468a-910b-9fa89f3f57c7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1406 microversion: 2.20 time: 0.194523 Nov 24 03:08:47.881515 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 376/722] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:08:47 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:08:48.057143 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.network.security_group_api [None req-71bcc105-2fe5-4fc2-8955-7c393d692ec9 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Removing security group 9758eaa8-8f9d-4d8e-82a2-3662d9e44202 from port 2ece000a-104a-46f1-8ab6-c4772032c9cf Nov 24 03:08:48.480332 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-71bcc105-2fe5-4fc2-8955-7c393d692ec9 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "POST /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c/action" status: 202 len: 0 microversion: 2.1 time: 0.660164 Nov 24 03:08:48.481489 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 347/723] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:08:47 2021] POST /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c/action => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 03:08:48.500039 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-68a13cbd-cdd5-4b64-9f96-7ae2c8dcf2b0 req-e9834926-e4b1-401f-99b1-15223154a199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7751b5e-4ff9-4a10-be90-35dc8498899c", "tag": "2ece000a-104a-46f1-8ab6-c4772032c9cf"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:08:48.502318 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:08:48.502318 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:08:48.524699 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-68a13cbd-cdd5-4b64-9f96-7ae2c8dcf2b0 req-e9834926-e4b1-401f-99b1-15223154a199 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:48.533163 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-68a13cbd-cdd5-4b64-9f96-7ae2c8dcf2b0 req-e9834926-e4b1-401f-99b1-15223154a199 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:48.572432 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-68a13cbd-cdd5-4b64-9f96-7ae2c8dcf2b0 req-e9834926-e4b1-401f-99b1-15223154a199 service nova] Creating event network-changed:2ece000a-104a-46f1-8ab6-c4772032c9cf for instance d7751b5e-4ff9-4a10-be90-35dc8498899c on hv-cinder-81803 Nov 24 03:08:48.596912 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-68a13cbd-cdd5-4b64-9f96-7ae2c8dcf2b0 req-e9834926-e4b1-401f-99b1-15223154a199 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104433 Nov 24 03:08:48.604797 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 377/724] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:08:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:08:48.916125 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ff3699fc-c4c2-4767-b8d5-dbfe9a7a2bd4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:48.917323 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ff3699fc-c4c2-4767-b8d5-dbfe9a7a2bd4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:48.930344 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff3699fc-c4c2-4767-b8d5-dbfe9a7a2bd4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:48.931133 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff3699fc-c4c2-4767-b8d5-dbfe9a7a2bd4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:48.933007 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff3699fc-c4c2-4767-b8d5-dbfe9a7a2bd4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:48.933766 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff3699fc-c4c2-4767-b8d5-dbfe9a7a2bd4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:49.614902 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ff3699fc-c4c2-4767-b8d5-dbfe9a7a2bd4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:49.647713 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ff3699fc-c4c2-4767-b8d5-dbfe9a7a2bd4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:49.649385 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ff3699fc-c4c2-4767-b8d5-dbfe9a7a2bd4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:49.655061 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ff3699fc-c4c2-4767-b8d5-dbfe9a7a2bd4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1598 microversion: 2.20 time: 0.747678 Nov 24 03:08:49.665856 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 348/725] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:08:48 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1598 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:08:49.683909 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-a91eb4b8-de1e-4065-9ad6-4fa8096e7d42 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:49.684598 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-a91eb4b8-de1e-4065-9ad6-4fa8096e7d42 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:49.691725 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a91eb4b8-de1e-4065-9ad6-4fa8096e7d42 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:49.692332 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a91eb4b8-de1e-4065-9ad6-4fa8096e7d42 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:49.697740 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a91eb4b8-de1e-4065-9ad6-4fa8096e7d42 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:49.697740 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a91eb4b8-de1e-4065-9ad6-4fa8096e7d42 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:49.795609 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-a91eb4b8-de1e-4065-9ad6-4fa8096e7d42 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.116192 Nov 24 03:08:49.796527 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 378/726] 10.222.0.52 () {60 vars in 1315 bytes} [Wed Nov 24 03:08:49 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:08:50.584037 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-04087a16-27b8-4d15-b6e1-6a12ec0a27cc tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:50.585848 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-04087a16-27b8-4d15-b6e1-6a12ec0a27cc tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:50.598510 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-04087a16-27b8-4d15-b6e1-6a12ec0a27cc tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:50.599444 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-04087a16-27b8-4d15-b6e1-6a12ec0a27cc tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:50.601025 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-04087a16-27b8-4d15-b6e1-6a12ec0a27cc tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:50.602017 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-04087a16-27b8-4d15-b6e1-6a12ec0a27cc tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:50.614112 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-185e30eb-ef28-4b6f-9c52-2f48a19c4946 req-938c31f4-50ab-4d61-bbec-15a48cb8cc42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7751b5e-4ff9-4a10-be90-35dc8498899c", "tag": "2ece000a-104a-46f1-8ab6-c4772032c9cf"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:08:50.616510 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:08:50.616510 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:08:50.624954 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-185e30eb-ef28-4b6f-9c52-2f48a19c4946 req-938c31f4-50ab-4d61-bbec-15a48cb8cc42 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:50.626390 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-185e30eb-ef28-4b6f-9c52-2f48a19c4946 req-938c31f4-50ab-4d61-bbec-15a48cb8cc42 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:50.640344 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-185e30eb-ef28-4b6f-9c52-2f48a19c4946 req-938c31f4-50ab-4d61-bbec-15a48cb8cc42 service nova] Creating event network-changed:2ece000a-104a-46f1-8ab6-c4772032c9cf for instance d7751b5e-4ff9-4a10-be90-35dc8498899c on hv-cinder-81803 Nov 24 03:08:50.657126 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-185e30eb-ef28-4b6f-9c52-2f48a19c4946 req-938c31f4-50ab-4d61-bbec-15a48cb8cc42 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046506 Nov 24 03:08:50.658314 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 379/727] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:08:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:08:50.747877 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-04087a16-27b8-4d15-b6e1-6a12ec0a27cc tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lazy-loading 'services' on Instance uuid d7751b5e-4ff9-4a10-be90-35dc8498899c {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:08:50.858414 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-04087a16-27b8-4d15-b6e1-6a12ec0a27cc tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c/os-volume_attachments/966293a7-b3e4-417d-ab42-7b3f8cb2bacd" status: 202 len: 0 microversion: 2.1 time: 0.282138 Nov 24 03:08:50.867996 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 349/728] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Nov 24 03:08:50 2021] DELETE /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c/os-volume_attachments/966293a7-b3e4-417d-ab42-7b3f8cb2bacd => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:08:50.869903 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-349e0017-dee6-4787-8497-ed6a309c7a41 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:50.871792 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-349e0017-dee6-4787-8497-ed6a309c7a41 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:50.885534 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-349e0017-dee6-4787-8497-ed6a309c7a41 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:50.886061 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-349e0017-dee6-4787-8497-ed6a309c7a41 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:50.886950 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-349e0017-dee6-4787-8497-ed6a309c7a41 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:50.887425 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-349e0017-dee6-4787-8497-ed6a309c7a41 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:50.989977 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-349e0017-dee6-4787-8497-ed6a309c7a41 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124689 Nov 24 03:08:50.991215 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 380/729] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Nov 24 03:08:50 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:08:51.809438 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-93cc0122-e9db-4fda-9bdf-7d5d93a96737 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:08:51.810931 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-93cc0122-e9db-4fda-9bdf-7d5d93a96737 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:51.814374 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-f4a7017c-0072-4edd-b69c-17c47296e0e8 req-2e7d2810-25e5-47c6-9a09-b2f2aa0bdaca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c38b798-2640-427f-915e-9a40f83e3b6e", "tag": "2e14e194-347c-4bad-a3ce-d09d56be7ce1"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:08:51.816103 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:08:51.816103 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:08:51.819296 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-93cc0122-e9db-4fda-9bdf-7d5d93a96737 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:51.819937 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-93cc0122-e9db-4fda-9bdf-7d5d93a96737 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:51.821090 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-93cc0122-e9db-4fda-9bdf-7d5d93a96737 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:51.822110 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-93cc0122-e9db-4fda-9bdf-7d5d93a96737 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:51.834986 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-f4a7017c-0072-4edd-b69c-17c47296e0e8 req-2e7d2810-25e5-47c6-9a09-b2f2aa0bdaca service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:51.835492 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-f4a7017c-0072-4edd-b69c-17c47296e0e8 req-2e7d2810-25e5-47c6-9a09-b2f2aa0bdaca service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:51.860111 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-f4a7017c-0072-4edd-b69c-17c47296e0e8 req-2e7d2810-25e5-47c6-9a09-b2f2aa0bdaca service nova] Creating event network-changed:2e14e194-347c-4bad-a3ce-d09d56be7ce1 for instance 5c38b798-2640-427f-915e-9a40f83e3b6e on hv-cinder-81803 Nov 24 03:08:51.867652 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-f4a7017c-0072-4edd-b69c-17c47296e0e8 req-2e7d2810-25e5-47c6-9a09-b2f2aa0bdaca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057699 Nov 24 03:08:51.869000 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 381/730] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:08:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:08:51.911946 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-93cc0122-e9db-4fda-9bdf-7d5d93a96737 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 14 microversion: 2.20 time: 0.107571 Nov 24 03:08:51.913054 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 350/731] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:08:51 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:52.004990 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e3d3f741-002f-473b-9a03-9eae8f028140 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:52.006034 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e3d3f741-002f-473b-9a03-9eae8f028140 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:52.013980 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e3d3f741-002f-473b-9a03-9eae8f028140 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:52.014740 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e3d3f741-002f-473b-9a03-9eae8f028140 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:52.015782 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e3d3f741-002f-473b-9a03-9eae8f028140 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:52.016743 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e3d3f741-002f-473b-9a03-9eae8f028140 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:52.056521 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e3d3f741-002f-473b-9a03-9eae8f028140 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056538 Nov 24 03:08:52.062031 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 382/732] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Nov 24 03:08:51 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:08:52.069233 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8a55840c-ad5c-447d-bb8e-1c4a2c99f252 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:52.070024 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8a55840c-ad5c-447d-bb8e-1c4a2c99f252 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:52.077397 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8a55840c-ad5c-447d-bb8e-1c4a2c99f252 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:52.077853 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8a55840c-ad5c-447d-bb8e-1c4a2c99f252 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:52.078700 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8a55840c-ad5c-447d-bb8e-1c4a2c99f252 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:52.079292 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8a55840c-ad5c-447d-bb8e-1c4a2c99f252 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:52.205834 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-8a55840c-ad5c-447d-bb8e-1c4a2c99f252 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] HTTP exception thrown: Instance d7751b5e-4ff9-4a10-be90-35dc8498899c is not attached to volume 966293a7-b3e4-417d-ab42-7b3f8cb2bacd Nov 24 03:08:52.207175 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8a55840c-ad5c-447d-bb8e-1c4a2c99f252 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Returning 404 to user: Instance d7751b5e-4ff9-4a10-be90-35dc8498899c is not attached to volume 966293a7-b3e4-417d-ab42-7b3f8cb2bacd {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:08:52.208786 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8a55840c-ad5c-447d-bb8e-1c4a2c99f252 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c/os-volume_attachments/966293a7-b3e4-417d-ab42-7b3f8cb2bacd" status: 404 len: 154 microversion: 2.1 time: 0.144332 Nov 24 03:08:52.209807 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 351/733] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Nov 24 03:08:52 2021] DELETE /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c/os-volume_attachments/966293a7-b3e4-417d-ab42-7b3f8cb2bacd => generated 154 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:08:52.924593 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ba48cbcd-534f-4021-a077-d3814fa54162 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:08:52.925507 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ba48cbcd-534f-4021-a077-d3814fa54162 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:52.931826 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ba48cbcd-534f-4021-a077-d3814fa54162 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:52.932284 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ba48cbcd-534f-4021-a077-d3814fa54162 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:52.933112 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ba48cbcd-534f-4021-a077-d3814fa54162 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:52.933545 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ba48cbcd-534f-4021-a077-d3814fa54162 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:53.393938 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-45c6e6fe-7092-4c9a-b99a-f65dbb10b5b6 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:53.394542 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-45c6e6fe-7092-4c9a-b99a-f65dbb10b5b6 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:53.401735 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-45c6e6fe-7092-4c9a-b99a-f65dbb10b5b6 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:53.402262 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-45c6e6fe-7092-4c9a-b99a-f65dbb10b5b6 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:53.403037 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-45c6e6fe-7092-4c9a-b99a-f65dbb10b5b6 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:53.403487 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-45c6e6fe-7092-4c9a-b99a-f65dbb10b5b6 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:53.428422 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-45c6e6fe-7092-4c9a-b99a-f65dbb10b5b6 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:08:53.509775 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-45c6e6fe-7092-4c9a-b99a-f65dbb10b5b6 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 204 len: 0 microversion: 2.1 time: 0.120195 Nov 24 03:08:53.510241 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 352/734] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:08:53 2021] DELETE /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:08:53.520297 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e0bc4dec-6a1d-4e70-8a5a-37e3365ceb11 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:53.521010 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e0bc4dec-6a1d-4e70-8a5a-37e3365ceb11 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:53.527027 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e0bc4dec-6a1d-4e70-8a5a-37e3365ceb11 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:53.527461 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e0bc4dec-6a1d-4e70-8a5a-37e3365ceb11 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:53.528231 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e0bc4dec-6a1d-4e70-8a5a-37e3365ceb11 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:53.528656 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e0bc4dec-6a1d-4e70-8a5a-37e3365ceb11 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:53.671342 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e0bc4dec-6a1d-4e70-8a5a-37e3365ceb11 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:53.680266 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e0bc4dec-6a1d-4e70-8a5a-37e3365ceb11 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1554 microversion: 2.1 time: 0.164193 Nov 24 03:08:53.680838 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 353/735] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:53 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:08:54.697597 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a4c0dc27-5d25-434e-afee-a8e80c28156c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:54.698350 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a4c0dc27-5d25-434e-afee-a8e80c28156c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:54.705096 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a4c0dc27-5d25-434e-afee-a8e80c28156c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:54.705515 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a4c0dc27-5d25-434e-afee-a8e80c28156c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:54.706382 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a4c0dc27-5d25-434e-afee-a8e80c28156c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:54.706820 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a4c0dc27-5d25-434e-afee-a8e80c28156c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:54.861643 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a4c0dc27-5d25-434e-afee-a8e80c28156c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:54.869959 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a4c0dc27-5d25-434e-afee-a8e80c28156c tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1554 microversion: 2.1 time: 0.175958 Nov 24 03:08:54.871019 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 354/736] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:54 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:55.672117 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ba48cbcd-534f-4021-a077-d3814fa54162 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 14 microversion: 2.20 time: 2.751162 Nov 24 03:08:55.673024 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 383/737] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:08:52 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 14 bytes in 2753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:55.892581 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4c75252f-19ed-4341-9e47-1128ec11b7d7 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:55.894078 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4c75252f-19ed-4341-9e47-1128ec11b7d7 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:55.903088 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4c75252f-19ed-4341-9e47-1128ec11b7d7 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:55.903518 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4c75252f-19ed-4341-9e47-1128ec11b7d7 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:55.904344 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4c75252f-19ed-4341-9e47-1128ec11b7d7 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:55.904844 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4c75252f-19ed-4341-9e47-1128ec11b7d7 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:56.055725 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4c75252f-19ed-4341-9e47-1128ec11b7d7 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:56.063957 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4c75252f-19ed-4341-9e47-1128ec11b7d7 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1554 microversion: 2.1 time: 0.176771 Nov 24 03:08:56.065007 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 355/738] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:55 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:56.684225 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4f135b9c-72cc-44f8-bfa6-6295ef99efa3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:08:56.685289 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4f135b9c-72cc-44f8-bfa6-6295ef99efa3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:56.693689 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4f135b9c-72cc-44f8-bfa6-6295ef99efa3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:56.694361 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4f135b9c-72cc-44f8-bfa6-6295ef99efa3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:56.695451 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4f135b9c-72cc-44f8-bfa6-6295ef99efa3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:56.695902 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4f135b9c-72cc-44f8-bfa6-6295ef99efa3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:56.770435 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4f135b9c-72cc-44f8-bfa6-6295ef99efa3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 14 microversion: 2.20 time: 0.090394 Nov 24 03:08:56.774630 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 384/739] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:08:56 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:57.082284 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8c97a1fd-6799-4ffe-b491-17104f15d2b1 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:57.082923 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8c97a1fd-6799-4ffe-b491-17104f15d2b1 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:57.089892 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8c97a1fd-6799-4ffe-b491-17104f15d2b1 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:57.090372 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8c97a1fd-6799-4ffe-b491-17104f15d2b1 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:57.091180 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8c97a1fd-6799-4ffe-b491-17104f15d2b1 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:57.091618 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8c97a1fd-6799-4ffe-b491-17104f15d2b1 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:57.242753 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8c97a1fd-6799-4ffe-b491-17104f15d2b1 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:57.250767 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8c97a1fd-6799-4ffe-b491-17104f15d2b1 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1554 microversion: 2.1 time: 0.172421 Nov 24 03:08:57.251333 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 356/740] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:57 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:08:57.785096 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-bf34cd13-4eb9-4560-81a8-26578bbd49ff tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:08:57.786394 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-bf34cd13-4eb9-4560-81a8-26578bbd49ff tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:57.795367 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bf34cd13-4eb9-4560-81a8-26578bbd49ff tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:57.795820 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bf34cd13-4eb9-4560-81a8-26578bbd49ff tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:57.796654 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bf34cd13-4eb9-4560-81a8-26578bbd49ff tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:57.797067 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bf34cd13-4eb9-4560-81a8-26578bbd49ff tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:58.273400 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d598f5b8-ca6a-493e-be98-f1cf97ccc22d tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:58.274052 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d598f5b8-ca6a-493e-be98-f1cf97ccc22d tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:58.281041 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d598f5b8-ca6a-493e-be98-f1cf97ccc22d tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:58.281497 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d598f5b8-ca6a-493e-be98-f1cf97ccc22d tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:58.282917 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d598f5b8-ca6a-493e-be98-f1cf97ccc22d tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:58.283343 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d598f5b8-ca6a-493e-be98-f1cf97ccc22d tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:58.436206 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d598f5b8-ca6a-493e-be98-f1cf97ccc22d tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:58.447220 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d598f5b8-ca6a-493e-be98-f1cf97ccc22d tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1554 microversion: 2.1 time: 0.177573 Nov 24 03:08:58.450239 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 357/741] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:58 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:08:59.466777 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7d591069-1a41-43cf-9b91-790e2a8b88e4 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:08:59.467496 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7d591069-1a41-43cf-9b91-790e2a8b88e4 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:08:59.474952 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d591069-1a41-43cf-9b91-790e2a8b88e4 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:59.475407 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d591069-1a41-43cf-9b91-790e2a8b88e4 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:59.476219 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d591069-1a41-43cf-9b91-790e2a8b88e4 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:08:59.476694 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d591069-1a41-43cf-9b91-790e2a8b88e4 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:08:59.654668 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7d591069-1a41-43cf-9b91-790e2a8b88e4 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:08:59.663368 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7d591069-1a41-43cf-9b91-790e2a8b88e4 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1554 microversion: 2.1 time: 0.200425 Nov 24 03:08:59.663983 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 358/742] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:08:59 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1554 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:09:00.251861 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-bf34cd13-4eb9-4560-81a8-26578bbd49ff tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 14 microversion: 2.20 time: 2.472403 Nov 24 03:09:00.253119 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 385/743] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:08:57 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 14 bytes in 2475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:09:00.686176 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-38fc41f8-b6eb-460d-935b-c98fcc4d6b57 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:00.687726 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-38fc41f8-b6eb-460d-935b-c98fcc4d6b57 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:00.699196 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-38fc41f8-b6eb-460d-935b-c98fcc4d6b57 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:00.700478 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-38fc41f8-b6eb-460d-935b-c98fcc4d6b57 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:00.701992 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-38fc41f8-b6eb-460d-935b-c98fcc4d6b57 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:00.702764 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-38fc41f8-b6eb-460d-935b-c98fcc4d6b57 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:01.060365 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-38fc41f8-b6eb-460d-935b-c98fcc4d6b57 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5757898fb3a467b8e5558d55906d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd704828d96416e8c51b5330f2e067e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:01.073884 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-38fc41f8-b6eb-460d-935b-c98fcc4d6b57 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 200 len: 1554 microversion: 2.1 time: 0.394695 Nov 24 03:09:01.074930 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 359/744] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:09:00 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 1554 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:09:01.267614 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b296cf0f-04a0-4123-8036-f3792961606e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:01.268733 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b296cf0f-04a0-4123-8036-f3792961606e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:01.278173 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b296cf0f-04a0-4123-8036-f3792961606e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:01.278684 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b296cf0f-04a0-4123-8036-f3792961606e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:01.279570 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b296cf0f-04a0-4123-8036-f3792961606e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:01.280015 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b296cf0f-04a0-4123-8036-f3792961606e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:01.354780 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b296cf0f-04a0-4123-8036-f3792961606e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 14 microversion: 2.20 time: 0.092677 Nov 24 03:09:01.358320 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 386/745] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:01 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:09:01.401478 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-5ed40909-d4c2-434b-b734-f636fb71ef33 req-c6745f8a-cbc2-4c25-ad32-ba0b5af5e0c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7751b5e-4ff9-4a10-be90-35dc8498899c", "name": "network-vif-deleted", "tag": "2ece000a-104a-46f1-8ab6-c4772032c9cf"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:01.404348 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:09:01.404348 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:09:01.418653 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-5ed40909-d4c2-434b-b734-f636fb71ef33 req-c6745f8a-cbc2-4c25-ad32-ba0b5af5e0c4 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:01.418903 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-5ed40909-d4c2-434b-b734-f636fb71ef33 req-c6745f8a-cbc2-4c25-ad32-ba0b5af5e0c4 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:01.438313 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-5ed40909-d4c2-434b-b734-f636fb71ef33 req-c6745f8a-cbc2-4c25-ad32-ba0b5af5e0c4 service nova] Creating event network-vif-deleted:2ece000a-104a-46f1-8ab6-c4772032c9cf for instance d7751b5e-4ff9-4a10-be90-35dc8498899c on hv-cinder-81803 Nov 24 03:09:01.444810 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-5ed40909-d4c2-434b-b734-f636fb71ef33 req-c6745f8a-cbc2-4c25-ad32-ba0b5af5e0c4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047107 Nov 24 03:09:01.445799 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 360/746] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:09:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:09:02.096865 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2bb484fe-cf1a-45ac-972a-1465cb8d424b tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:02.097844 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2bb484fe-cf1a-45ac-972a-1465cb8d424b tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] [instance: d7751b5e-4ff9-4a10-be90-35dc8498899c] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:02.105444 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2bb484fe-cf1a-45ac-972a-1465cb8d424b tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:02.105892 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2bb484fe-cf1a-45ac-972a-1465cb8d424b tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:02.106709 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2bb484fe-cf1a-45ac-972a-1465cb8d424b tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:02.107157 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2bb484fe-cf1a-45ac-972a-1465cb8d424b tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:02.123230 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-2bb484fe-cf1a-45ac-972a-1465cb8d424b tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] HTTP exception thrown: Instance d7751b5e-4ff9-4a10-be90-35dc8498899c could not be found. Nov 24 03:09:02.123833 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2bb484fe-cf1a-45ac-972a-1465cb8d424b tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Returning 404 to user: Instance d7751b5e-4ff9-4a10-be90-35dc8498899c could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:09:02.124715 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2bb484fe-cf1a-45ac-972a-1465cb8d424b tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c" status: 404 len: 111 microversion: 2.1 time: 0.032509 Nov 24 03:09:02.125303 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 387/747] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:09:02 2021] GET /compute/v2.1/servers/d7751b5e-4ff9-4a10-be90-35dc8498899c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 03:09:02.135095 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-32b85636-1644-474c-a090-f4c16ad0f690 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] Calling method '.version_select at 0x7f7a2de8d550>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:02.156284 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-32b85636-1644-474c-a090-f4c16ad0f690 tempest-TestMinimumBasicScenario-1740618428 tempest-TestMinimumBasicScenario-1740618428-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2076920807" status: 202 len: 0 microversion: 2.1 time: 0.025107 Nov 24 03:09:02.156873 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 361/748] 10.222.0.52 () {58 vars in 1271 bytes} [Wed Nov 24 03:09:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2076920807 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:02.623174 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-634d84ea-4a8c-4caf-a6cd-c15d3a72e6d9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:02.624925 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-634d84ea-4a8c-4caf-a6cd-c15d3a72e6d9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:02.639226 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-634d84ea-4a8c-4caf-a6cd-c15d3a72e6d9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:02.639739 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-634d84ea-4a8c-4caf-a6cd-c15d3a72e6d9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:02.640991 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-634d84ea-4a8c-4caf-a6cd-c15d3a72e6d9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:02.642377 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-634d84ea-4a8c-4caf-a6cd-c15d3a72e6d9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:02.742271 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-634d84ea-4a8c-4caf-a6cd-c15d3a72e6d9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 14 microversion: 2.20 time: 0.378436 Nov 24 03:09:02.746845 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 388/749] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:02 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 14 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:09:03.753982 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e61409f3-ff42-400d-b5f8-644cc2fc71c9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:03.755993 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e61409f3-ff42-400d-b5f8-644cc2fc71c9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:03.764823 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e61409f3-ff42-400d-b5f8-644cc2fc71c9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:03.765273 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e61409f3-ff42-400d-b5f8-644cc2fc71c9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:03.767510 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e61409f3-ff42-400d-b5f8-644cc2fc71c9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:03.767510 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e61409f3-ff42-400d-b5f8-644cc2fc71c9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:03.860835 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e61409f3-ff42-400d-b5f8-644cc2fc71c9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 6451 microversion: 2.20 time: 0.110805 Nov 24 03:09:03.862518 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 362/750] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:03 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 6451 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:09:04.874929 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-67031c72-860e-45f8-903d-72e25b81df0a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:04.876005 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-67031c72-860e-45f8-903d-72e25b81df0a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:04.884002 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-67031c72-860e-45f8-903d-72e25b81df0a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:04.884561 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-67031c72-860e-45f8-903d-72e25b81df0a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:04.885488 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-67031c72-860e-45f8-903d-72e25b81df0a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:04.886054 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-67031c72-860e-45f8-903d-72e25b81df0a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:07.126284 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-67031c72-860e-45f8-903d-72e25b81df0a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 19342 microversion: 2.20 time: 2.255244 Nov 24 03:09:07.127859 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 389/751] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:04 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 19342 bytes in 2258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:08.140605 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e2eeb3fa-62e3-4d9e-94af-d1733b71eee4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:08.142024 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e2eeb3fa-62e3-4d9e-94af-d1733b71eee4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:08.150105 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e2eeb3fa-62e3-4d9e-94af-d1733b71eee4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:08.150563 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e2eeb3fa-62e3-4d9e-94af-d1733b71eee4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:08.151367 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e2eeb3fa-62e3-4d9e-94af-d1733b71eee4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:08.152092 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e2eeb3fa-62e3-4d9e-94af-d1733b71eee4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:08.234152 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e2eeb3fa-62e3-4d9e-94af-d1733b71eee4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 21668 microversion: 2.20 time: 0.097450 Nov 24 03:09:08.235192 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 363/752] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:08 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 21668 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:09.250457 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-452be11e-f7b7-470e-86f6-d6a53a756ce8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:09.251572 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-452be11e-f7b7-470e-86f6-d6a53a756ce8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:09.260176 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-452be11e-f7b7-470e-86f6-d6a53a756ce8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:09.260632 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-452be11e-f7b7-470e-86f6-d6a53a756ce8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:09.261455 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-452be11e-f7b7-470e-86f6-d6a53a756ce8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:09.261932 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-452be11e-f7b7-470e-86f6-d6a53a756ce8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:09.341740 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-452be11e-f7b7-470e-86f6-d6a53a756ce8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 23167 microversion: 2.20 time: 0.095667 Nov 24 03:09:09.342444 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 390/753] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:09 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 23167 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:10.357577 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3fb476cd-836e-4a73-a586-4d9f3f0f99e1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:10.359964 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3fb476cd-836e-4a73-a586-4d9f3f0f99e1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:10.367884 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3fb476cd-836e-4a73-a586-4d9f3f0f99e1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:10.368315 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3fb476cd-836e-4a73-a586-4d9f3f0f99e1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:10.369110 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3fb476cd-836e-4a73-a586-4d9f3f0f99e1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:10.369826 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3fb476cd-836e-4a73-a586-4d9f3f0f99e1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:10.448943 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3fb476cd-836e-4a73-a586-4d9f3f0f99e1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 24444 microversion: 2.20 time: 0.095651 Nov 24 03:09:10.450537 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 364/754] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:10 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 24444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:11.498431 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-a347e810-34dd-4860-8501-a4dfb56a7f3c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:11.507338 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-a347e810-34dd-4860-8501-a4dfb56a7f3c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:11.533368 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a347e810-34dd-4860-8501-a4dfb56a7f3c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:11.534243 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a347e810-34dd-4860-8501-a4dfb56a7f3c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:11.542746 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a347e810-34dd-4860-8501-a4dfb56a7f3c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:11.543624 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a347e810-34dd-4860-8501-a4dfb56a7f3c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:11.656172 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-a347e810-34dd-4860-8501-a4dfb56a7f3c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 26123 microversion: 2.20 time: 0.196154 Nov 24 03:09:11.662789 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 391/755] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:11 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 26123 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:12.670861 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-df9a4418-e0e8-4661-9eb5-fc9c5fcef155 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:12.673490 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-df9a4418-e0e8-4661-9eb5-fc9c5fcef155 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:12.681565 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df9a4418-e0e8-4661-9eb5-fc9c5fcef155 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:12.682121 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df9a4418-e0e8-4661-9eb5-fc9c5fcef155 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:12.683009 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df9a4418-e0e8-4661-9eb5-fc9c5fcef155 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:12.683457 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df9a4418-e0e8-4661-9eb5-fc9c5fcef155 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:14.678965 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-df9a4418-e0e8-4661-9eb5-fc9c5fcef155 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 27770 microversion: 2.20 time: 2.012066 Nov 24 03:09:14.679658 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 365/756] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:12 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 27770 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:15.691976 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-118f251e-8d93-403e-a852-4ee0844df2b1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:15.692992 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-118f251e-8d93-403e-a852-4ee0844df2b1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:15.701393 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-118f251e-8d93-403e-a852-4ee0844df2b1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:15.701907 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-118f251e-8d93-403e-a852-4ee0844df2b1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:15.702784 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-118f251e-8d93-403e-a852-4ee0844df2b1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:15.703223 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-118f251e-8d93-403e-a852-4ee0844df2b1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:15.781879 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-118f251e-8d93-403e-a852-4ee0844df2b1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 28198 microversion: 2.20 time: 0.093895 Nov 24 03:09:15.782578 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 392/757] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:15 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 28198 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:16.797324 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c4384e83-0f15-4ae3-b7fc-b2658bf3d942 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:16.798467 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c4384e83-0f15-4ae3-b7fc-b2658bf3d942 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:16.808617 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4384e83-0f15-4ae3-b7fc-b2658bf3d942 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:16.809069 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4384e83-0f15-4ae3-b7fc-b2658bf3d942 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:16.809957 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4384e83-0f15-4ae3-b7fc-b2658bf3d942 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:16.810435 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4384e83-0f15-4ae3-b7fc-b2658bf3d942 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:16.901750 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c4384e83-0f15-4ae3-b7fc-b2658bf3d942 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 28213 microversion: 2.20 time: 0.109885 Nov 24 03:09:16.902443 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 366/758] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:16 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 28213 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:17.914091 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-bf015a99-a025-4e40-bae8-04e8ca21f7e6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:17.915203 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-bf015a99-a025-4e40-bae8-04e8ca21f7e6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:17.923524 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bf015a99-a025-4e40-bae8-04e8ca21f7e6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:17.923967 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bf015a99-a025-4e40-bae8-04e8ca21f7e6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:17.924769 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bf015a99-a025-4e40-bae8-04e8ca21f7e6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:17.925207 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bf015a99-a025-4e40-bae8-04e8ca21f7e6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:18.003924 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-bf015a99-a025-4e40-bae8-04e8ca21f7e6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 28489 microversion: 2.20 time: 0.093858 Nov 24 03:09:18.004612 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 393/759] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:17 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 28489 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:19.017556 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5ef0bf1f-fa27-4793-8038-c67fa4139f5b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:19.018627 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5ef0bf1f-fa27-4793-8038-c67fa4139f5b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:19.026415 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5ef0bf1f-fa27-4793-8038-c67fa4139f5b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:19.026867 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5ef0bf1f-fa27-4793-8038-c67fa4139f5b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:19.027664 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5ef0bf1f-fa27-4793-8038-c67fa4139f5b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:19.028098 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5ef0bf1f-fa27-4793-8038-c67fa4139f5b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:19.110001 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5ef0bf1f-fa27-4793-8038-c67fa4139f5b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 28657 microversion: 2.20 time: 0.097001 Nov 24 03:09:19.110669 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 367/760] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:19 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 28657 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:20.124206 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0f3c1a8c-fd94-47c1-ae35-489516886792 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:20.125235 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0f3c1a8c-fd94-47c1-ae35-489516886792 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:20.133520 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0f3c1a8c-fd94-47c1-ae35-489516886792 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:20.134134 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0f3c1a8c-fd94-47c1-ae35-489516886792 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:20.134962 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0f3c1a8c-fd94-47c1-ae35-489516886792 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:20.135391 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0f3c1a8c-fd94-47c1-ae35-489516886792 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:20.203831 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0f3c1a8c-fd94-47c1-ae35-489516886792 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 28657 microversion: 2.20 time: 0.084869 Nov 24 03:09:20.207927 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 394/761] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:20 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 28657 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:21.216600 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7498d0a3-a6be-4fdf-88c5-5879ee423332 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:21.217780 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7498d0a3-a6be-4fdf-88c5-5879ee423332 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:21.225230 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7498d0a3-a6be-4fdf-88c5-5879ee423332 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:21.225681 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7498d0a3-a6be-4fdf-88c5-5879ee423332 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:21.226512 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7498d0a3-a6be-4fdf-88c5-5879ee423332 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:21.226949 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7498d0a3-a6be-4fdf-88c5-5879ee423332 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:21.299635 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7498d0a3-a6be-4fdf-88c5-5879ee423332 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 28657 microversion: 2.20 time: 0.086964 Nov 24 03:09:21.300301 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 368/762] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:21 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 28657 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:22.316045 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2f4330bc-b43e-4954-98e6-d7e14662f667 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:22.317140 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2f4330bc-b43e-4954-98e6-d7e14662f667 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:22.327707 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2f4330bc-b43e-4954-98e6-d7e14662f667 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:22.328546 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2f4330bc-b43e-4954-98e6-d7e14662f667 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:22.329618 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2f4330bc-b43e-4954-98e6-d7e14662f667 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:22.330421 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2f4330bc-b43e-4954-98e6-d7e14662f667 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:22.356417 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c707b700-5d1a-478b-88c2-8b66cde76812 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:22.357442 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c707b700-5d1a-478b-88c2-8b66cde76812 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:22.367383 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c707b700-5d1a-478b-88c2-8b66cde76812 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:22.368200 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c707b700-5d1a-478b-88c2-8b66cde76812 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:22.369029 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c707b700-5d1a-478b-88c2-8b66cde76812 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:22.369469 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c707b700-5d1a-478b-88c2-8b66cde76812 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:22.402930 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c707b700-5d1a-478b-88c2-8b66cde76812 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051515 Nov 24 03:09:22.403522 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 369/763] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Nov 24 03:09:22 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:09:22.413357 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2f4330bc-b43e-4954-98e6-d7e14662f667 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 28963 microversion: 2.20 time: 0.101166 Nov 24 03:09:22.417284 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 395/764] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:22 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 28963 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:22.467244 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-30594c08-cb5b-4eeb-93ca-9b5f46893a98 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:22.467838 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-30594c08-cb5b-4eeb-93ca-9b5f46893a98 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:22.477027 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-30594c08-cb5b-4eeb-93ca-9b5f46893a98 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:22.477497 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-30594c08-cb5b-4eeb-93ca-9b5f46893a98 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:22.478729 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-30594c08-cb5b-4eeb-93ca-9b5f46893a98 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:22.479321 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-30594c08-cb5b-4eeb-93ca-9b5f46893a98 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:22.510433 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-30594c08-cb5b-4eeb-93ca-9b5f46893a98 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:09:22.607060 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-30594c08-cb5b-4eeb-93ca-9b5f46893a98 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 204 len: 0 microversion: 2.1 time: 0.145479 Nov 24 03:09:22.607647 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 370/765] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:09:22 2021] DELETE /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 03:09:22.618913 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c6466b34-f805-45bc-a44f-40fc94bdf727 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:22.619632 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c6466b34-f805-45bc-a44f-40fc94bdf727 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:22.626784 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c6466b34-f805-45bc-a44f-40fc94bdf727 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:22.627252 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c6466b34-f805-45bc-a44f-40fc94bdf727 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:22.628035 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c6466b34-f805-45bc-a44f-40fc94bdf727 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:22.628505 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c6466b34-f805-45bc-a44f-40fc94bdf727 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:22.800617 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c6466b34-f805-45bc-a44f-40fc94bdf727 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:22.813248 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c6466b34-f805-45bc-a44f-40fc94bdf727 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1674 microversion: 2.1 time: 0.200042 Nov 24 03:09:22.813989 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 396/766] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:09:22 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1674 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:09:23.426224 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-cd1e924d-37a0-40ec-b5c7-81aff6279a87 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:23.427248 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-cd1e924d-37a0-40ec-b5c7-81aff6279a87 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:23.434875 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cd1e924d-37a0-40ec-b5c7-81aff6279a87 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:23.435305 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cd1e924d-37a0-40ec-b5c7-81aff6279a87 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:23.436134 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cd1e924d-37a0-40ec-b5c7-81aff6279a87 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:23.436568 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cd1e924d-37a0-40ec-b5c7-81aff6279a87 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:23.515358 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-cd1e924d-37a0-40ec-b5c7-81aff6279a87 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 30610 microversion: 2.20 time: 0.093188 Nov 24 03:09:23.516326 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 371/767] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:23 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 30610 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:23.830962 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ced91ec6-20ca-4119-882f-d389c1f19204 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:23.831534 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ced91ec6-20ca-4119-882f-d389c1f19204 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:23.839253 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ced91ec6-20ca-4119-882f-d389c1f19204 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:23.839719 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ced91ec6-20ca-4119-882f-d389c1f19204 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:23.840526 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ced91ec6-20ca-4119-882f-d389c1f19204 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:23.840951 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ced91ec6-20ca-4119-882f-d389c1f19204 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:23.991241 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ced91ec6-20ca-4119-882f-d389c1f19204 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:23.999608 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ced91ec6-20ca-4119-882f-d389c1f19204 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1674 microversion: 2.1 time: 0.172472 Nov 24 03:09:24.000204 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 397/768] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:09:23 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:09:24.528523 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e1d281a1-f0f9-41ba-a5e5-62bdfcbcdfee tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:24.529422 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e1d281a1-f0f9-41ba-a5e5-62bdfcbcdfee tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:24.536452 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e1d281a1-f0f9-41ba-a5e5-62bdfcbcdfee tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:24.536905 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e1d281a1-f0f9-41ba-a5e5-62bdfcbcdfee tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:24.537685 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e1d281a1-f0f9-41ba-a5e5-62bdfcbcdfee tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:24.538141 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e1d281a1-f0f9-41ba-a5e5-62bdfcbcdfee tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:24.613665 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e1d281a1-f0f9-41ba-a5e5-62bdfcbcdfee tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 32231 microversion: 2.20 time: 0.089149 Nov 24 03:09:24.614457 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 372/769] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:24 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 32231 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:25.018269 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e5d9c3de-9063-4874-a2c9-21b1b1b47fc6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:25.018876 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e5d9c3de-9063-4874-a2c9-21b1b1b47fc6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:25.025946 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e5d9c3de-9063-4874-a2c9-21b1b1b47fc6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:25.026409 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e5d9c3de-9063-4874-a2c9-21b1b1b47fc6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:25.027214 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e5d9c3de-9063-4874-a2c9-21b1b1b47fc6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:25.027616 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e5d9c3de-9063-4874-a2c9-21b1b1b47fc6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:25.177263 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e5d9c3de-9063-4874-a2c9-21b1b1b47fc6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:25.185221 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e5d9c3de-9063-4874-a2c9-21b1b1b47fc6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1674 microversion: 2.1 time: 0.171165 Nov 24 03:09:25.185812 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 398/770] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:09:25 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:09:25.626643 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b754c8a7-9228-42f6-9f2d-88624259c947 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:25.627706 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b754c8a7-9228-42f6-9f2d-88624259c947 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:25.635120 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b754c8a7-9228-42f6-9f2d-88624259c947 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:25.635552 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b754c8a7-9228-42f6-9f2d-88624259c947 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:25.636359 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b754c8a7-9228-42f6-9f2d-88624259c947 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:25.636792 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b754c8a7-9228-42f6-9f2d-88624259c947 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:25.722153 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b754c8a7-9228-42f6-9f2d-88624259c947 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 33582 microversion: 2.20 time: 0.099462 Nov 24 03:09:25.722804 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 373/771] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:25 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 33582 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 03:09:26.112982 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-694d7238-15f1-454f-b79e-aa9bed372acc req-88b24ed6-6029-435c-a81c-783ee278047f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9b822e-b442-450a-acaa-df8261422f50", "name": "network-vif-deleted", "tag": "c3568a99-3dfd-41f8-9643-ad9aa328f79e"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:26.115324 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:09:26.115324 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:09:26.123021 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-694d7238-15f1-454f-b79e-aa9bed372acc req-88b24ed6-6029-435c-a81c-783ee278047f service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:26.123465 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-694d7238-15f1-454f-b79e-aa9bed372acc req-88b24ed6-6029-435c-a81c-783ee278047f service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:26.135708 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-694d7238-15f1-454f-b79e-aa9bed372acc req-88b24ed6-6029-435c-a81c-783ee278047f service nova] Creating event network-vif-deleted:c3568a99-3dfd-41f8-9643-ad9aa328f79e for instance dd9b822e-b442-450a-acaa-df8261422f50 on hv-cinder-81803 Nov 24 03:09:26.141337 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-694d7238-15f1-454f-b79e-aa9bed372acc req-88b24ed6-6029-435c-a81c-783ee278047f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.277660 Nov 24 03:09:26.142361 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 399/772] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:09:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:09:26.203944 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7091d9d6-71b5-45ea-b797-7ca30ecbb706 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:26.205026 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7091d9d6-71b5-45ea-b797-7ca30ecbb706 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:26.212603 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7091d9d6-71b5-45ea-b797-7ca30ecbb706 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:26.213326 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7091d9d6-71b5-45ea-b797-7ca30ecbb706 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:26.214179 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7091d9d6-71b5-45ea-b797-7ca30ecbb706 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:26.214632 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7091d9d6-71b5-45ea-b797-7ca30ecbb706 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:26.252152 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7091d9d6-71b5-45ea-b797-7ca30ecbb706 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:26.252741 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7091d9d6-71b5-45ea-b797-7ca30ecbb706 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:26.253409 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-7091d9d6-71b5-45ea-b797-7ca30ecbb706 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lazy-loading 'fault' on Instance uuid dd9b822e-b442-450a-acaa-df8261422f50 {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:09:26.306008 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7091d9d6-71b5-45ea-b797-7ca30ecbb706 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:26.314730 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7091d9d6-71b5-45ea-b797-7ca30ecbb706 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 200 len: 1327 microversion: 2.1 time: 0.115174 Nov 24 03:09:26.315499 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 374/773] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:09:26 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 1327 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:09:26.735143 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-088a22d0-4221-4c7f-bdb2-1736ffdf95c4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:26.736153 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-088a22d0-4221-4c7f-bdb2-1736ffdf95c4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:26.742957 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-088a22d0-4221-4c7f-bdb2-1736ffdf95c4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:26.743388 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-088a22d0-4221-4c7f-bdb2-1736ffdf95c4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:26.744183 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-088a22d0-4221-4c7f-bdb2-1736ffdf95c4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:26.744613 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-088a22d0-4221-4c7f-bdb2-1736ffdf95c4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:26.825485 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-088a22d0-4221-4c7f-bdb2-1736ffdf95c4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 34729 microversion: 2.20 time: 0.094443 Nov 24 03:09:26.829565 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 400/774] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:26 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 34729 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:27.332767 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-39c0b3b1-d634-401e-96cd-a79a5158ed8f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:27.333436 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-39c0b3b1-d634-401e-96cd-a79a5158ed8f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:27.340751 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-39c0b3b1-d634-401e-96cd-a79a5158ed8f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:27.341109 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-39c0b3b1-d634-401e-96cd-a79a5158ed8f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:27.341906 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-39c0b3b1-d634-401e-96cd-a79a5158ed8f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:27.342374 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-39c0b3b1-d634-401e-96cd-a79a5158ed8f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:27.358049 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-39c0b3b1-d634-401e-96cd-a79a5158ed8f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] HTTP exception thrown: Instance dd9b822e-b442-450a-acaa-df8261422f50 could not be found. Nov 24 03:09:27.358644 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-39c0b3b1-d634-401e-96cd-a79a5158ed8f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Returning 404 to user: Instance dd9b822e-b442-450a-acaa-df8261422f50 could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:09:27.359488 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-39c0b3b1-d634-401e-96cd-a79a5158ed8f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 404 len: 111 microversion: 2.1 time: 0.030557 Nov 24 03:09:27.360094 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 375/775] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:09:27 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:09:27.369867 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-9def2782-0b37-47da-9f5e-e183f71122eb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '.version_select at 0x7f7a2ddd84c0>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:27.392612 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-9def2782-0b37-47da-9f5e-e183f71122eb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-526221247" status: 202 len: 0 microversion: 2.1 time: 0.027311 Nov 24 03:09:27.393386 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 401/776] 10.222.0.52 () {58 vars in 1217 bytes} [Wed Nov 24 03:09:27 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-526221247 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:27.837968 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-eca432a2-c173-41e6-aa34-7a82ff854406 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:27.838938 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-eca432a2-c173-41e6-aa34-7a82ff854406 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:27.845780 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eca432a2-c173-41e6-aa34-7a82ff854406 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:27.846278 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eca432a2-c173-41e6-aa34-7a82ff854406 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:27.847081 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eca432a2-c173-41e6-aa34-7a82ff854406 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:27.847573 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eca432a2-c173-41e6-aa34-7a82ff854406 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:27.928114 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-eca432a2-c173-41e6-aa34-7a82ff854406 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 35898 microversion: 2.20 time: 0.094216 Nov 24 03:09:27.929014 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 376/777] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:27 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 35898 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:28.179578 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-537b6c05-05a9-4430-8185-32c2964c56f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'create', calling method: .version_select at 0x7f7a2dd89ee0>, body: {"keypair": {"name": "tempest-keypair-1979423901"}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:28.197297 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-537b6c05-05a9-4430-8185-32c2964c56f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Getting quotas for project 1368b90b7cae4e3d936fcd3a97893dc3. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:09:28.202652 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-537b6c05-05a9-4430-8185-32c2964c56f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Getting quotas for user 22bd0f1d66884b66945eec4ede0aea0d and project 1368b90b7cae4e3d936fcd3a97893dc3. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:09:28.397974 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-537b6c05-05a9-4430-8185-32c2964c56f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Getting quotas for project 1368b90b7cae4e3d936fcd3a97893dc3. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:09:28.402959 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-537b6c05-05a9-4430-8185-32c2964c56f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Getting quotas for user 22bd0f1d66884b66945eec4ede0aea0d and project 1368b90b7cae4e3d936fcd3a97893dc3. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:09:28.419333 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-537b6c05-05a9-4430-8185-32c2964c56f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.244405 Nov 24 03:09:28.419968 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 402/778] 10.222.0.52 () {60 vars in 1157 bytes} [Wed Nov 24 03:09:28 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:09:28.945574 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-394d3fd3-1872-4365-b27a-c4ebba532bd4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:28.946810 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-394d3fd3-1872-4365-b27a-c4ebba532bd4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:28.956139 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-394d3fd3-1872-4365-b27a-c4ebba532bd4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:28.956489 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-394d3fd3-1872-4365-b27a-c4ebba532bd4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:28.957334 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-394d3fd3-1872-4365-b27a-c4ebba532bd4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:28.957780 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-394d3fd3-1872-4365-b27a-c4ebba532bd4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:29.053847 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-394d3fd3-1872-4365-b27a-c4ebba532bd4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 37707 microversion: 2.20 time: 0.113961 Nov 24 03:09:29.055315 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 377/779] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:28 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 37707 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:30.046510 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4a3e9e42-cdf7-4ab0-8e70-3eacb1e10bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-332971183", "imageRef": "04860a4a-47c3-4532-865d-be6c9c493af7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7a7cf95-a9a7-490c-b4d6-a3f8cc395176"}], "security_groups": [{"name": "tempest-securitygroup--1295141814"}], "key_name": "tempest-keypair-1979423901", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:30.068834 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-977e3baa-7524-4a9c-b29b-42203bd754f6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:30.069989 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-977e3baa-7524-4a9c-b29b-42203bd754f6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:30.079092 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-977e3baa-7524-4a9c-b29b-42203bd754f6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:30.080056 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-977e3baa-7524-4a9c-b29b-42203bd754f6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:30.081104 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-977e3baa-7524-4a9c-b29b-42203bd754f6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:30.081671 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-977e3baa-7524-4a9c-b29b-42203bd754f6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:30.163291 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-977e3baa-7524-4a9c-b29b-42203bd754f6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 38212 microversion: 2.20 time: 0.098330 Nov 24 03:09:30.164777 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 378/780] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:30 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 38212 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 03:09:30.193572 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.network.neutron [None req-4a3e9e42-cdf7-4ab0-8e70-3eacb1e10bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] validate_networks() for [('f7a7cf95-a9a7-490c-b4d6-a3f8cc395176', None, None, None, None, None)] {{(pid=116331) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:09:30.758502 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-4a3e9e42-cdf7-4ab0-8e70-3eacb1e10bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Flavor limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:09:30.758923 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-4a3e9e42-cdf7-4ab0-8e70-3eacb1e10bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Image limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:09:30.759385 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-4a3e9e42-cdf7-4ab0-8e70-3eacb1e10bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Flavor pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:09:30.759785 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-4a3e9e42-cdf7-4ab0-8e70-3eacb1e10bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Image pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:09:30.760189 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-4a3e9e42-cdf7-4ab0-8e70-3eacb1e10bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:09:30.774832 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4a3e9e42-cdf7-4ab0-8e70-3eacb1e10bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:30.775636 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4a3e9e42-cdf7-4ab0-8e70-3eacb1e10bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:30.777160 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4a3e9e42-cdf7-4ab0-8e70-3eacb1e10bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:30.777965 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4a3e9e42-cdf7-4ab0-8e70-3eacb1e10bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:30.810311 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-4a3e9e42-cdf7-4ab0-8e70-3eacb1e10bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Getting quotas for project 1368b90b7cae4e3d936fcd3a97893dc3. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:09:30.818893 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-4a3e9e42-cdf7-4ab0-8e70-3eacb1e10bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Getting quotas for user 22bd0f1d66884b66945eec4ede0aea0d and project 1368b90b7cae4e3d936fcd3a97893dc3. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:09:30.839606 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4a3e9e42-cdf7-4ab0-8e70-3eacb1e10bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Going to run 1 instances... {{(pid=116331) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:09:30.844435 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4a3e9e42-cdf7-4ab0-8e70-3eacb1e10bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04860a4a-47c3-4532-865d-be6c9c493af7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:09:30.926797 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4a3e9e42-cdf7-4ab0-8e70-3eacb1e10bed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.884708 Nov 24 03:09:30.927787 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 403/781] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Nov 24 03:09:30 2021] POST /compute/v2.1/servers => generated 402 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 03:09:30.945575 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7020d581-5a80-485f-81fb-33ab6ea20ade tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:30.946924 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7020d581-5a80-485f-81fb-33ab6ea20ade tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:31.027511 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7020d581-5a80-485f-81fb-33ab6ea20ade tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:31.036857 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7020d581-5a80-485f-81fb-33ab6ea20ade tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d" status: 200 len: 1237 microversion: 2.1 time: 0.098582 Nov 24 03:09:31.037465 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 379/782] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:09:30 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d => generated 1237 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:09:31.182268 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-676cba79-9cd4-480f-a51c-d5f26997b932 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:31.183742 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-676cba79-9cd4-480f-a51c-d5f26997b932 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:31.196042 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-676cba79-9cd4-480f-a51c-d5f26997b932 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:31.196800 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-676cba79-9cd4-480f-a51c-d5f26997b932 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:31.201441 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-676cba79-9cd4-480f-a51c-d5f26997b932 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:31.202373 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-676cba79-9cd4-480f-a51c-d5f26997b932 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:31.289726 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-676cba79-9cd4-480f-a51c-d5f26997b932 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 38212 microversion: 2.20 time: 0.115656 Nov 24 03:09:31.290664 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 404/783] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:31 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 38212 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:32.060016 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b15de289-3230-4798-b949-d22ce809dfc5 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:32.063134 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b15de289-3230-4798-b949-d22ce809dfc5 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:32.072829 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b15de289-3230-4798-b949-d22ce809dfc5 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:32.073522 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b15de289-3230-4798-b949-d22ce809dfc5 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:32.074587 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b15de289-3230-4798-b949-d22ce809dfc5 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:32.075334 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b15de289-3230-4798-b949-d22ce809dfc5 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:32.162729 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b15de289-3230-4798-b949-d22ce809dfc5 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:32.180261 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b15de289-3230-4798-b949-d22ce809dfc5 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d" status: 200 len: 1289 microversion: 2.1 time: 0.125428 Nov 24 03:09:32.181852 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 380/784] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:09:32 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d => generated 1289 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:09:32.310679 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e1966f4d-d27a-4bab-babd-75fd55fd6e11 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:32.312937 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e1966f4d-d27a-4bab-babd-75fd55fd6e11 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:32.325636 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e1966f4d-d27a-4bab-babd-75fd55fd6e11 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:32.326465 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e1966f4d-d27a-4bab-babd-75fd55fd6e11 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:32.327911 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e1966f4d-d27a-4bab-babd-75fd55fd6e11 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:32.328684 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e1966f4d-d27a-4bab-babd-75fd55fd6e11 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:32.405278 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e1966f4d-d27a-4bab-babd-75fd55fd6e11 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 38212 microversion: 2.20 time: 0.103106 Nov 24 03:09:32.406476 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 405/785] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:32 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 38212 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:09:33.201612 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ebcab95a-4219-40c8-8ed9-dabea597a4b0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:33.202519 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ebcab95a-4219-40c8-8ed9-dabea597a4b0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:33.213892 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ebcab95a-4219-40c8-8ed9-dabea597a4b0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:33.215014 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ebcab95a-4219-40c8-8ed9-dabea597a4b0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:33.216651 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ebcab95a-4219-40c8-8ed9-dabea597a4b0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:33.217545 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ebcab95a-4219-40c8-8ed9-dabea597a4b0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:33.421236 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-3273cb9b-0d0a-4604-843b-ab19b536eeb4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:33.424393 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-3273cb9b-0d0a-4604-843b-ab19b536eeb4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:33.438448 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3273cb9b-0d0a-4604-843b-ab19b536eeb4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:33.439813 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3273cb9b-0d0a-4604-843b-ab19b536eeb4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:33.441899 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3273cb9b-0d0a-4604-843b-ab19b536eeb4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:33.442692 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3273cb9b-0d0a-4604-843b-ab19b536eeb4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:33.515559 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ebcab95a-4219-40c8-8ed9-dabea597a4b0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:33.526956 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ebcab95a-4219-40c8-8ed9-dabea597a4b0 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d" status: 200 len: 1363 microversion: 2.1 time: 0.331540 Nov 24 03:09:33.528011 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 381/786] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:09:33 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:09:33.544354 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-3273cb9b-0d0a-4604-843b-ab19b536eeb4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 38226 microversion: 2.20 time: 0.128476 Nov 24 03:09:33.545465 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 406/787] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:33 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 38226 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 03:09:34.226747 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-eb168ac2-14be-4a81-8946-7f2034e4637d req-5bee8a6f-9936-4af4-a505-d574266ed435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d", "tag": "e4a550de-aba7-444f-a02c-0c033cb2032d"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:34.233040 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:09:34.233040 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:09:34.251586 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-eb168ac2-14be-4a81-8946-7f2034e4637d req-5bee8a6f-9936-4af4-a505-d574266ed435 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:34.252919 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-eb168ac2-14be-4a81-8946-7f2034e4637d req-5bee8a6f-9936-4af4-a505-d574266ed435 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:34.275320 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-eb168ac2-14be-4a81-8946-7f2034e4637d req-5bee8a6f-9936-4af4-a505-d574266ed435 service nova] Creating event network-changed:e4a550de-aba7-444f-a02c-0c033cb2032d for instance e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d on hv-cinder-81803 Nov 24 03:09:34.283619 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-eb168ac2-14be-4a81-8946-7f2034e4637d req-5bee8a6f-9936-4af4-a505-d574266ed435 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064580 Nov 24 03:09:34.284844 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 382/788] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:09:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:09:34.554619 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-6cd1b4a8-4488-423b-b84b-876081544b06 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:34.555648 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-6cd1b4a8-4488-423b-b84b-876081544b06 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:34.560246 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-15435d19-34c7-4d08-825f-95753d478f18 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:34.562009 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-15435d19-34c7-4d08-825f-95753d478f18 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:34.563679 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6cd1b4a8-4488-423b-b84b-876081544b06 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:34.564260 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6cd1b4a8-4488-423b-b84b-876081544b06 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:34.565382 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6cd1b4a8-4488-423b-b84b-876081544b06 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:34.565962 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6cd1b4a8-4488-423b-b84b-876081544b06 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:34.571988 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15435d19-34c7-4d08-825f-95753d478f18 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:34.573071 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15435d19-34c7-4d08-825f-95753d478f18 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:34.574270 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15435d19-34c7-4d08-825f-95753d478f18 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:34.574831 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15435d19-34c7-4d08-825f-95753d478f18 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:34.647945 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-15435d19-34c7-4d08-825f-95753d478f18 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 200 len: 38353 microversion: 2.20 time: 0.094836 Nov 24 03:09:34.649306 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 383/789] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:34 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 38353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 03:09:34.665024 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9fd30966-16d2-40dc-b4e6-186cccaa1d8b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:34.665777 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9fd30966-16d2-40dc-b4e6-186cccaa1d8b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:34.678845 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9fd30966-16d2-40dc-b4e6-186cccaa1d8b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:34.679899 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9fd30966-16d2-40dc-b4e6-186cccaa1d8b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:34.681445 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9fd30966-16d2-40dc-b4e6-186cccaa1d8b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:34.682485 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9fd30966-16d2-40dc-b4e6-186cccaa1d8b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:34.716632 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9fd30966-16d2-40dc-b4e6-186cccaa1d8b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/ips" status: 200 len: 151 microversion: 2.20 time: 0.060200 Nov 24 03:09:34.717233 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 384/790] 10.222.0.52 () {60 vars in 1288 bytes} [Wed Nov 24 03:09:34 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/ips => generated 151 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 03:09:34.774039 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-6cd1b4a8-4488-423b-b84b-876081544b06 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:34.786540 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-6cd1b4a8-4488-423b-b84b-876081544b06 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d" status: 200 len: 1363 microversion: 2.1 time: 0.237167 Nov 24 03:09:34.794890 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 407/791] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:09:34 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:09:35.807555 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-aef88c28-d9ee-4808-abf1-fe149d683342 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:35.808306 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-aef88c28-d9ee-4808-abf1-fe149d683342 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:35.815293 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aef88c28-d9ee-4808-abf1-fe149d683342 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:35.815729 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aef88c28-d9ee-4808-abf1-fe149d683342 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:35.816604 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aef88c28-d9ee-4808-abf1-fe149d683342 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:35.818367 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aef88c28-d9ee-4808-abf1-fe149d683342 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:35.993355 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-aef88c28-d9ee-4808-abf1-fe149d683342 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:36.005833 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-aef88c28-d9ee-4808-abf1-fe149d683342 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d" status: 200 len: 1363 microversion: 2.1 time: 0.201946 Nov 24 03:09:36.006924 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 385/792] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:09:35 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:09:37.027764 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-3bb64a68-1a68-4fec-90e7-e2f89e19002d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:37.028588 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-3bb64a68-1a68-4fec-90e7-e2f89e19002d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:37.036241 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3bb64a68-1a68-4fec-90e7-e2f89e19002d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:37.036700 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3bb64a68-1a68-4fec-90e7-e2f89e19002d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:37.037531 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3bb64a68-1a68-4fec-90e7-e2f89e19002d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:37.037998 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3bb64a68-1a68-4fec-90e7-e2f89e19002d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:37.191910 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-3bb64a68-1a68-4fec-90e7-e2f89e19002d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:37.201458 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-3bb64a68-1a68-4fec-90e7-e2f89e19002d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d" status: 200 len: 1363 microversion: 2.1 time: 0.177480 Nov 24 03:09:37.202191 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 408/793] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:09:37 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:09:38.226299 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b80cc667-5b74-4073-ab8d-1bcd391a95bb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:38.226919 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b80cc667-5b74-4073-ab8d-1bcd391a95bb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:38.233981 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b80cc667-5b74-4073-ab8d-1bcd391a95bb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:38.234432 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b80cc667-5b74-4073-ab8d-1bcd391a95bb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:38.235243 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b80cc667-5b74-4073-ab8d-1bcd391a95bb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:38.235679 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b80cc667-5b74-4073-ab8d-1bcd391a95bb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:38.408274 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b80cc667-5b74-4073-ab8d-1bcd391a95bb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:38.417313 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b80cc667-5b74-4073-ab8d-1bcd391a95bb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d" status: 200 len: 1363 microversion: 2.1 time: 0.194869 Nov 24 03:09:38.418002 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 386/794] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:09:38 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:09:39.440172 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-aa290ddb-eeb4-4dc0-8fff-e18bdb70563a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:39.441003 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-aa290ddb-eeb4-4dc0-8fff-e18bdb70563a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:39.455108 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-aa290ddb-eeb4-4dc0-8fff-e18bdb70563a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:39.455942 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-aa290ddb-eeb4-4dc0-8fff-e18bdb70563a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:39.457081 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-aa290ddb-eeb4-4dc0-8fff-e18bdb70563a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:39.457821 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-aa290ddb-eeb4-4dc0-8fff-e18bdb70563a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:39.600470 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-5c86a459-cb2d-41b7-88d9-c17dd57cb3f3 req-2cf7cf1c-2779-4cd0-bb6e-0f6aba13a86b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d", "name": "network-vif-plugged", "status": "completed", "tag": "e4a550de-aba7-444f-a02c-0c033cb2032d"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:39.602433 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:09:39.602433 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:09:39.610212 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-5c86a459-cb2d-41b7-88d9-c17dd57cb3f3 req-2cf7cf1c-2779-4cd0-bb6e-0f6aba13a86b service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:39.610660 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-5c86a459-cb2d-41b7-88d9-c17dd57cb3f3 req-2cf7cf1c-2779-4cd0-bb6e-0f6aba13a86b service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:39.624752 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-5c86a459-cb2d-41b7-88d9-c17dd57cb3f3 req-2cf7cf1c-2779-4cd0-bb6e-0f6aba13a86b service nova] Creating event network-vif-plugged:e4a550de-aba7-444f-a02c-0c033cb2032d for instance e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d on hv-cinder-81803 Nov 24 03:09:39.630823 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-5c86a459-cb2d-41b7-88d9-c17dd57cb3f3 req-2cf7cf1c-2779-4cd0-bb6e-0f6aba13a86b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143945 Nov 24 03:09:39.631458 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 387/795] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:09:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:09:39.639476 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-aa290ddb-eeb4-4dc0-8fff-e18bdb70563a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:39.649585 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-aa290ddb-eeb4-4dc0-8fff-e18bdb70563a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d" status: 200 len: 1363 microversion: 2.1 time: 0.217479 Nov 24 03:09:39.650384 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 409/796] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:09:39 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:09:40.667886 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bcdfacef-e45d-4c95-bb2d-56137db98efe tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:40.668619 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bcdfacef-e45d-4c95-bb2d-56137db98efe tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:40.675814 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bcdfacef-e45d-4c95-bb2d-56137db98efe tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:40.676261 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bcdfacef-e45d-4c95-bb2d-56137db98efe tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:40.677057 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bcdfacef-e45d-4c95-bb2d-56137db98efe tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:40.677487 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bcdfacef-e45d-4c95-bb2d-56137db98efe tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:40.824328 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-bcdfacef-e45d-4c95-bb2d-56137db98efe tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:40.833713 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bcdfacef-e45d-4c95-bb2d-56137db98efe tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d" status: 200 len: 1363 microversion: 2.1 time: 0.170332 Nov 24 03:09:40.834608 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 388/797] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:09:40 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:09:41.852185 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-6591f575-7c4e-4608-a863-5f2bfd71de0b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:41.852793 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-6591f575-7c4e-4608-a863-5f2bfd71de0b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:41.859793 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6591f575-7c4e-4608-a863-5f2bfd71de0b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:41.860256 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6591f575-7c4e-4608-a863-5f2bfd71de0b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:41.861054 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6591f575-7c4e-4608-a863-5f2bfd71de0b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:41.861498 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6591f575-7c4e-4608-a863-5f2bfd71de0b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:42.005038 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-6591f575-7c4e-4608-a863-5f2bfd71de0b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:42.013362 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-6591f575-7c4e-4608-a863-5f2bfd71de0b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d" status: 200 len: 1549 microversion: 2.1 time: 0.165378 Nov 24 03:09:42.013989 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 410/798] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:09:41 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:09:42.030854 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-658e81b0-d52c-43be-91fe-ed58494df720 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:42.031487 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-658e81b0-d52c-43be-91fe-ed58494df720 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:42.038162 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-658e81b0-d52c-43be-91fe-ed58494df720 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:42.038808 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-658e81b0-d52c-43be-91fe-ed58494df720 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:42.039832 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-658e81b0-d52c-43be-91fe-ed58494df720 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:42.040273 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-658e81b0-d52c-43be-91fe-ed58494df720 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:42.127265 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-658e81b0-d52c-43be-91fe-ed58494df720 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100085 Nov 24 03:09:42.127880 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 389/799] 10.222.0.52 () {58 vars in 1274 bytes} [Wed Nov 24 03:09:42 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:09:43.390204 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e88acb38-93f0-489b-a512-031a05fca108 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:43.392011 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e88acb38-93f0-489b-a512-031a05fca108 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:43.403339 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e88acb38-93f0-489b-a512-031a05fca108 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:43.404177 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e88acb38-93f0-489b-a512-031a05fca108 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:43.405846 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e88acb38-93f0-489b-a512-031a05fca108 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:43.406673 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e88acb38-93f0-489b-a512-031a05fca108 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:43.456479 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-61e4b22c-8bee-457e-aab4-4fd65eaa9004 req-98606efc-84f9-4a94-8fa2-f7931b553bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d", "tag": "e4a550de-aba7-444f-a02c-0c033cb2032d"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:43.458271 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:09:43.458271 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:09:43.466456 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-61e4b22c-8bee-457e-aab4-4fd65eaa9004 req-98606efc-84f9-4a94-8fa2-f7931b553bf1 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:43.466811 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-61e4b22c-8bee-457e-aab4-4fd65eaa9004 req-98606efc-84f9-4a94-8fa2-f7931b553bf1 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:43.472440 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e88acb38-93f0-489b-a512-031a05fca108 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 14 microversion: 2.1 time: 0.085605 Nov 24 03:09:43.473747 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 411/800] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:09:43 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:09:43.479994 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-61e4b22c-8bee-457e-aab4-4fd65eaa9004 req-98606efc-84f9-4a94-8fa2-f7931b553bf1 service nova] Creating event network-changed:e4a550de-aba7-444f-a02c-0c033cb2032d for instance e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d on hv-cinder-81803 Nov 24 03:09:43.485499 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-61e4b22c-8bee-457e-aab4-4fd65eaa9004 req-98606efc-84f9-4a94-8fa2-f7931b553bf1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097351 Nov 24 03:09:43.486179 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 390/801] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:09:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:09:44.487601 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c500543d-36c9-4049-a805-e9f1b17940ed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:44.492004 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c500543d-36c9-4049-a805-e9f1b17940ed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:44.498921 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c500543d-36c9-4049-a805-e9f1b17940ed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:44.499367 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c500543d-36c9-4049-a805-e9f1b17940ed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:44.500179 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c500543d-36c9-4049-a805-e9f1b17940ed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:44.500604 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c500543d-36c9-4049-a805-e9f1b17940ed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:44.575403 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c500543d-36c9-4049-a805-e9f1b17940ed tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 14 microversion: 2.1 time: 0.093774 Nov 24 03:09:44.578006 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 412/802] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:09:44 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:09:45.588349 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c9748066-e7c0-4745-9e4a-108fcbda40f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:45.589286 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c9748066-e7c0-4745-9e4a-108fcbda40f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:45.595974 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c9748066-e7c0-4745-9e4a-108fcbda40f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:45.596417 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c9748066-e7c0-4745-9e4a-108fcbda40f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:45.597193 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c9748066-e7c0-4745-9e4a-108fcbda40f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:45.597621 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c9748066-e7c0-4745-9e4a-108fcbda40f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:45.657483 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c9748066-e7c0-4745-9e4a-108fcbda40f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 14 microversion: 2.1 time: 0.073195 Nov 24 03:09:45.658500 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 391/803] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:09:45 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:09:46.670502 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-d656cc71-21fd-4628-9a58-757bc86c9354 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:46.671607 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-d656cc71-21fd-4628-9a58-757bc86c9354 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:46.683134 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d656cc71-21fd-4628-9a58-757bc86c9354 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:46.683675 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d656cc71-21fd-4628-9a58-757bc86c9354 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:46.685190 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d656cc71-21fd-4628-9a58-757bc86c9354 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:46.685624 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d656cc71-21fd-4628-9a58-757bc86c9354 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:46.753304 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-d656cc71-21fd-4628-9a58-757bc86c9354 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 14 microversion: 2.1 time: 0.086763 Nov 24 03:09:46.753990 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 413/804] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:09:46 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:09:47.766450 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3e732f92-9509-451e-9ee0-4435e4ae9f28 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:47.767583 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3e732f92-9509-451e-9ee0-4435e4ae9f28 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:47.777176 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3e732f92-9509-451e-9ee0-4435e4ae9f28 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:47.777733 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3e732f92-9509-451e-9ee0-4435e4ae9f28 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:47.778763 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3e732f92-9509-451e-9ee0-4435e4ae9f28 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:47.779288 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3e732f92-9509-451e-9ee0-4435e4ae9f28 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:47.963670 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3e732f92-9509-451e-9ee0-4435e4ae9f28 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 14 microversion: 2.1 time: 0.202000 Nov 24 03:09:47.964306 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 392/805] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:09:47 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 14 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:09:48.977012 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-222e82ac-a2a1-4919-a17e-6b18c0892c6e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:48.978048 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-222e82ac-a2a1-4919-a17e-6b18c0892c6e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:48.985571 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-222e82ac-a2a1-4919-a17e-6b18c0892c6e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:48.986039 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-222e82ac-a2a1-4919-a17e-6b18c0892c6e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:48.986841 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-222e82ac-a2a1-4919-a17e-6b18c0892c6e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:48.987269 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-222e82ac-a2a1-4919-a17e-6b18c0892c6e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:49.051729 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-222e82ac-a2a1-4919-a17e-6b18c0892c6e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 14 microversion: 2.1 time: 0.078006 Nov 24 03:09:49.052581 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 414/806] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:09:48 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:09:50.067756 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-06396af6-2396-4b53-8864-e1adc3866399 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:50.068873 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-06396af6-2396-4b53-8864-e1adc3866399 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:50.080298 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06396af6-2396-4b53-8864-e1adc3866399 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:50.080968 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06396af6-2396-4b53-8864-e1adc3866399 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:50.082335 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06396af6-2396-4b53-8864-e1adc3866399 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:50.082974 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06396af6-2396-4b53-8864-e1adc3866399 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:50.159402 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-06396af6-2396-4b53-8864-e1adc3866399 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 14 microversion: 2.1 time: 0.098172 Nov 24 03:09:50.160059 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 393/807] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:09:50 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:09:51.171967 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-09b4e03e-51df-4437-9988-366165818140 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:51.173024 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-09b4e03e-51df-4437-9988-366165818140 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:51.180824 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-09b4e03e-51df-4437-9988-366165818140 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:51.181275 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-09b4e03e-51df-4437-9988-366165818140 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:51.182119 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-09b4e03e-51df-4437-9988-366165818140 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:51.182561 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-09b4e03e-51df-4437-9988-366165818140 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:51.251613 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-09b4e03e-51df-4437-9988-366165818140 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 14 microversion: 2.1 time: 0.083680 Nov 24 03:09:51.252310 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 415/808] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:09:51 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:09:52.263535 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-686d20f5-efea-40b5-9e0c-7f9db600d4ac tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:52.264960 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-686d20f5-efea-40b5-9e0c-7f9db600d4ac tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:52.274270 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-686d20f5-efea-40b5-9e0c-7f9db600d4ac tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:52.274653 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-686d20f5-efea-40b5-9e0c-7f9db600d4ac tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:52.275482 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-686d20f5-efea-40b5-9e0c-7f9db600d4ac tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:52.275928 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-686d20f5-efea-40b5-9e0c-7f9db600d4ac tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:52.339519 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-686d20f5-efea-40b5-9e0c-7f9db600d4ac tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 14 microversion: 2.1 time: 0.079870 Nov 24 03:09:52.340224 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 394/809] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:09:52 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:09:52.365949 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-15d1b09e-484b-4bbc-b6b4-8433210f7194 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:52.366989 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-15d1b09e-484b-4bbc-b6b4-8433210f7194 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:52.374949 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-15d1b09e-484b-4bbc-b6b4-8433210f7194 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:52.375400 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-15d1b09e-484b-4bbc-b6b4-8433210f7194 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:52.376213 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-15d1b09e-484b-4bbc-b6b4-8433210f7194 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:52.376644 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-15d1b09e-484b-4bbc-b6b4-8433210f7194 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:52.403492 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.objects.instance [None req-15d1b09e-484b-4bbc-b6b4-8433210f7194 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lazy-loading 'flavor' on Instance uuid 5c38b798-2640-427f-915e-9a40f83e3b6e {{(pid=116331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:09:52.687814 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-15d1b09e-484b-4bbc-b6b4-8433210f7194 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 202 len: 0 microversion: 2.20 time: 0.325935 Nov 24 03:09:52.688507 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 416/810] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:09:52 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:09:52.701723 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-91f30600-c094-4043-acab-ece37ff955f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:52.703016 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-91f30600-c094-4043-acab-ece37ff955f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:52.716912 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-91f30600-c094-4043-acab-ece37ff955f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:52.716912 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-91f30600-c094-4043-acab-ece37ff955f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:52.716912 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-91f30600-c094-4043-acab-ece37ff955f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:52.716912 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-91f30600-c094-4043-acab-ece37ff955f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:52.875031 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-91f30600-c094-4043-acab-ece37ff955f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:52.885799 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-91f30600-c094-4043-acab-ece37ff955f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:52.887397 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-91f30600-c094-4043-acab-ece37ff955f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:52.888627 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-91f30600-c094-4043-acab-ece37ff955f0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.194449 Nov 24 03:09:52.889266 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 395/811] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:09:52 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:09:53.357571 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4f530bde-c75b-4c6e-9e4e-6df355b4200e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:53.358579 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4f530bde-c75b-4c6e-9e4e-6df355b4200e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:53.366831 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4f530bde-c75b-4c6e-9e4e-6df355b4200e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:53.367565 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4f530bde-c75b-4c6e-9e4e-6df355b4200e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:53.368372 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4f530bde-c75b-4c6e-9e4e-6df355b4200e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:53.368801 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4f530bde-c75b-4c6e-9e4e-6df355b4200e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:53.455897 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4f530bde-c75b-4c6e-9e4e-6df355b4200e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 10009 microversion: 2.1 time: 0.106282 Nov 24 03:09:53.456583 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 417/812] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:09:53 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 10009 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:09:53.908565 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ff08e944-567d-43b9-8d25-9537be3b5450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:53.909196 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ff08e944-567d-43b9-8d25-9537be3b5450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:53.916326 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff08e944-567d-43b9-8d25-9537be3b5450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:53.916770 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff08e944-567d-43b9-8d25-9537be3b5450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:53.917551 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff08e944-567d-43b9-8d25-9537be3b5450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:53.918282 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff08e944-567d-43b9-8d25-9537be3b5450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:54.074710 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ff08e944-567d-43b9-8d25-9537be3b5450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:54.083900 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ff08e944-567d-43b9-8d25-9537be3b5450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:54.086575 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ff08e944-567d-43b9-8d25-9537be3b5450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:54.087771 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ff08e944-567d-43b9-8d25-9537be3b5450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.183018 Nov 24 03:09:54.088344 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 396/813] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:09:53 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:09:54.469013 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ea05b504-d6f3-42d4-b44f-439bda3de49d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:54.470509 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ea05b504-d6f3-42d4-b44f-439bda3de49d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:54.478298 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ea05b504-d6f3-42d4-b44f-439bda3de49d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:54.478935 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ea05b504-d6f3-42d4-b44f-439bda3de49d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:54.479772 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ea05b504-d6f3-42d4-b44f-439bda3de49d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:54.480207 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ea05b504-d6f3-42d4-b44f-439bda3de49d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:54.563243 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ea05b504-d6f3-42d4-b44f-439bda3de49d tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 17401 microversion: 2.1 time: 0.098918 Nov 24 03:09:54.563938 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 418/814] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:09:54 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 17401 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:09:55.117070 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b02d96a6-48be-4ced-97bc-7d3fb961c52b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:55.117758 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b02d96a6-48be-4ced-97bc-7d3fb961c52b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:55.126649 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b02d96a6-48be-4ced-97bc-7d3fb961c52b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:55.127226 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b02d96a6-48be-4ced-97bc-7d3fb961c52b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:55.128839 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b02d96a6-48be-4ced-97bc-7d3fb961c52b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:55.129434 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b02d96a6-48be-4ced-97bc-7d3fb961c52b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:55.283924 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b02d96a6-48be-4ced-97bc-7d3fb961c52b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:55.293150 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b02d96a6-48be-4ced-97bc-7d3fb961c52b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:55.294698 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b02d96a6-48be-4ced-97bc-7d3fb961c52b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:55.295898 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b02d96a6-48be-4ced-97bc-7d3fb961c52b tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.184852 Nov 24 03:09:55.296485 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 397/815] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:09:55 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:09:55.576134 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-035ef8be-50ad-4536-82c2-d5d32183d8c4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:55.577150 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-035ef8be-50ad-4536-82c2-d5d32183d8c4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:55.584688 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-035ef8be-50ad-4536-82c2-d5d32183d8c4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:55.585127 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-035ef8be-50ad-4536-82c2-d5d32183d8c4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:55.586139 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-035ef8be-50ad-4536-82c2-d5d32183d8c4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:55.586674 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-035ef8be-50ad-4536-82c2-d5d32183d8c4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:55.658562 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-035ef8be-50ad-4536-82c2-d5d32183d8c4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 18498 microversion: 2.1 time: 0.086246 Nov 24 03:09:55.659302 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 419/816] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:09:55 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 18498 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:09:56.314931 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-477a14ab-0291-4d8a-85a7-ba5c236db72e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:56.315560 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-477a14ab-0291-4d8a-85a7-ba5c236db72e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:56.323231 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-477a14ab-0291-4d8a-85a7-ba5c236db72e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:56.323694 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-477a14ab-0291-4d8a-85a7-ba5c236db72e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:56.324491 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-477a14ab-0291-4d8a-85a7-ba5c236db72e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:56.324935 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-477a14ab-0291-4d8a-85a7-ba5c236db72e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:56.479009 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-477a14ab-0291-4d8a-85a7-ba5c236db72e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:56.487415 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-477a14ab-0291-4d8a-85a7-ba5c236db72e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:56.488970 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-477a14ab-0291-4d8a-85a7-ba5c236db72e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:56.490197 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-477a14ab-0291-4d8a-85a7-ba5c236db72e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.179031 Nov 24 03:09:56.490783 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 398/817] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:09:56 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:09:56.673347 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7552aa9d-f911-49a2-ae15-c413462b34a2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:56.674845 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-7552aa9d-f911-49a2-ae15-c413462b34a2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:56.686394 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7552aa9d-f911-49a2-ae15-c413462b34a2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:56.687078 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7552aa9d-f911-49a2-ae15-c413462b34a2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:56.688278 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7552aa9d-f911-49a2-ae15-c413462b34a2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:56.688873 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7552aa9d-f911-49a2-ae15-c413462b34a2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:56.762336 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7552aa9d-f911-49a2-ae15-c413462b34a2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 20997 microversion: 2.1 time: 0.094042 Nov 24 03:09:56.762892 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 420/818] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:09:56 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 20997 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:09:57.509610 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-eae54a42-1606-4a70-9a8c-6ddcace42de6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:57.510341 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-eae54a42-1606-4a70-9a8c-6ddcace42de6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:57.519984 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eae54a42-1606-4a70-9a8c-6ddcace42de6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:57.520579 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eae54a42-1606-4a70-9a8c-6ddcace42de6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:57.521669 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eae54a42-1606-4a70-9a8c-6ddcace42de6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:57.522398 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eae54a42-1606-4a70-9a8c-6ddcace42de6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:57.669208 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-eae54a42-1606-4a70-9a8c-6ddcace42de6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:57.678165 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-eae54a42-1606-4a70-9a8c-6ddcace42de6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:57.682344 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-eae54a42-1606-4a70-9a8c-6ddcace42de6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:57.682344 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-eae54a42-1606-4a70-9a8c-6ddcace42de6 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.176012 Nov 24 03:09:57.682344 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 399/819] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:09:57 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:09:57.778738 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-a0f36aea-74c5-4300-8694-ef1eeb1b13f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:57.779654 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-a0f36aea-74c5-4300-8694-ef1eeb1b13f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:57.786745 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a0f36aea-74c5-4300-8694-ef1eeb1b13f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:57.787188 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a0f36aea-74c5-4300-8694-ef1eeb1b13f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:57.787958 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a0f36aea-74c5-4300-8694-ef1eeb1b13f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:57.788402 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a0f36aea-74c5-4300-8694-ef1eeb1b13f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:57.864284 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-a0f36aea-74c5-4300-8694-ef1eeb1b13f2 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 22981 microversion: 2.1 time: 0.089598 Nov 24 03:09:57.864962 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 421/820] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:09:57 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 22981 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:09:58.701408 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-21c1f5fc-8da6-4c5b-a4dd-be35d0412d8d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:58.702047 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-21c1f5fc-8da6-4c5b-a4dd-be35d0412d8d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:58.708503 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-21c1f5fc-8da6-4c5b-a4dd-be35d0412d8d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:58.708951 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-21c1f5fc-8da6-4c5b-a4dd-be35d0412d8d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:58.709744 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-21c1f5fc-8da6-4c5b-a4dd-be35d0412d8d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:58.710198 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-21c1f5fc-8da6-4c5b-a4dd-be35d0412d8d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:58.860086 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-21c1f5fc-8da6-4c5b-a4dd-be35d0412d8d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:58.868480 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-21c1f5fc-8da6-4c5b-a4dd-be35d0412d8d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:58.870055 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-21c1f5fc-8da6-4c5b-a4dd-be35d0412d8d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:09:58.871564 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-21c1f5fc-8da6-4c5b-a4dd-be35d0412d8d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.173672 Nov 24 03:09:58.871994 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 400/821] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:09:58 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:09:58.881618 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4115a707-1a76-4d0a-b6dd-15233482e5fc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:58.884657 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4115a707-1a76-4d0a-b6dd-15233482e5fc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:58.895098 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4115a707-1a76-4d0a-b6dd-15233482e5fc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:58.895098 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4115a707-1a76-4d0a-b6dd-15233482e5fc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:58.896324 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4115a707-1a76-4d0a-b6dd-15233482e5fc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:58.896760 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4115a707-1a76-4d0a-b6dd-15233482e5fc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:58.975307 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4115a707-1a76-4d0a-b6dd-15233482e5fc tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 24631 microversion: 2.1 time: 0.101532 Nov 24 03:09:58.975972 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 422/822] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:09:58 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 24631 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:09:59.900202 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c2d728a6-a556-481e-bb0f-6c89e38be8e8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:09:59.900806 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c2d728a6-a556-481e-bb0f-6c89e38be8e8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:59.907691 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2d728a6-a556-481e-bb0f-6c89e38be8e8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:59.908150 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2d728a6-a556-481e-bb0f-6c89e38be8e8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:59.908955 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2d728a6-a556-481e-bb0f-6c89e38be8e8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:59.909404 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2d728a6-a556-481e-bb0f-6c89e38be8e8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:59.988906 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-d1cbd47c-b313-4cd0-a052-01d9b49da29f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:09:59.989950 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-d1cbd47c-b313-4cd0-a052-01d9b49da29f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:09:59.997863 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d1cbd47c-b313-4cd0-a052-01d9b49da29f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:59.998343 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d1cbd47c-b313-4cd0-a052-01d9b49da29f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:09:59.999137 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d1cbd47c-b313-4cd0-a052-01d9b49da29f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:09:59.999592 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d1cbd47c-b313-4cd0-a052-01d9b49da29f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:00.052314 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c2d728a6-a556-481e-bb0f-6c89e38be8e8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:00.060658 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c2d728a6-a556-481e-bb0f-6c89e38be8e8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:00.062183 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c2d728a6-a556-481e-bb0f-6c89e38be8e8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:00.063345 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c2d728a6-a556-481e-bb0f-6c89e38be8e8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.168100 Nov 24 03:10:00.063919 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 401/823] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:09:59 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:00.078526 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-d1cbd47c-b313-4cd0-a052-01d9b49da29f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 26240 microversion: 2.1 time: 0.094053 Nov 24 03:10:00.079198 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 423/824] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:09:59 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 26240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:10:01.086736 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c257d109-e8d2-4e31-a70f-0f79f88d2976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:01.087401 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c257d109-e8d2-4e31-a70f-0f79f88d2976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:01.092139 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2a8a7d61-778b-43d2-b28e-fcaa98556263 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:01.093170 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2a8a7d61-778b-43d2-b28e-fcaa98556263 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:01.094448 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c257d109-e8d2-4e31-a70f-0f79f88d2976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:01.094916 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c257d109-e8d2-4e31-a70f-0f79f88d2976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:01.095725 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c257d109-e8d2-4e31-a70f-0f79f88d2976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:01.096151 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c257d109-e8d2-4e31-a70f-0f79f88d2976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:01.101554 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2a8a7d61-778b-43d2-b28e-fcaa98556263 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:01.101554 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2a8a7d61-778b-43d2-b28e-fcaa98556263 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:01.102054 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2a8a7d61-778b-43d2-b28e-fcaa98556263 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:01.102464 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2a8a7d61-778b-43d2-b28e-fcaa98556263 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:01.180880 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2a8a7d61-778b-43d2-b28e-fcaa98556263 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 27445 microversion: 2.1 time: 0.092828 Nov 24 03:10:01.184737 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 424/825] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:01 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 27445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:10:01.249000 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c257d109-e8d2-4e31-a70f-0f79f88d2976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:01.257946 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c257d109-e8d2-4e31-a70f-0f79f88d2976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:01.259889 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c257d109-e8d2-4e31-a70f-0f79f88d2976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:01.261206 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c257d109-e8d2-4e31-a70f-0f79f88d2976 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.178937 Nov 24 03:10:01.261790 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 402/826] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:01 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:02.193397 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-42cef656-dd79-41ba-8752-7aa36c6e2404 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:02.194430 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-42cef656-dd79-41ba-8752-7aa36c6e2404 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:02.203033 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-42cef656-dd79-41ba-8752-7aa36c6e2404 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:02.203545 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-42cef656-dd79-41ba-8752-7aa36c6e2404 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:02.204811 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-42cef656-dd79-41ba-8752-7aa36c6e2404 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:02.205362 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-42cef656-dd79-41ba-8752-7aa36c6e2404 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:02.280342 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3620bc33-2b65-4dfe-ac70-a5e1b31ef7bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:02.280995 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3620bc33-2b65-4dfe-ac70-a5e1b31ef7bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:02.284665 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-42cef656-dd79-41ba-8752-7aa36c6e2404 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 27966 microversion: 2.1 time: 0.095220 Nov 24 03:10:02.285311 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 425/827] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:02 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 27966 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:10:02.292600 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3620bc33-2b65-4dfe-ac70-a5e1b31ef7bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:02.293051 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3620bc33-2b65-4dfe-ac70-a5e1b31ef7bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:02.293852 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3620bc33-2b65-4dfe-ac70-a5e1b31ef7bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:02.294407 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3620bc33-2b65-4dfe-ac70-a5e1b31ef7bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:02.452173 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3620bc33-2b65-4dfe-ac70-a5e1b31ef7bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:02.461469 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3620bc33-2b65-4dfe-ac70-a5e1b31ef7bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:02.462986 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3620bc33-2b65-4dfe-ac70-a5e1b31ef7bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:02.464133 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3620bc33-2b65-4dfe-ac70-a5e1b31ef7bb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.187711 Nov 24 03:10:02.464888 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 403/828] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:02 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:10:03.281110 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-fdb75026-50a9-467a-99c8-96f514211960 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:03.281996 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-fdb75026-50a9-467a-99c8-96f514211960 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:03.291836 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fdb75026-50a9-467a-99c8-96f514211960 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:03.292319 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fdb75026-50a9-467a-99c8-96f514211960 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:03.293129 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fdb75026-50a9-467a-99c8-96f514211960 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:03.293570 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fdb75026-50a9-467a-99c8-96f514211960 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:03.296744 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-75574ca1-827d-4685-807f-27136ed28feb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:03.297726 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-75574ca1-827d-4685-807f-27136ed28feb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:03.304243 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75574ca1-827d-4685-807f-27136ed28feb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:03.304700 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75574ca1-827d-4685-807f-27136ed28feb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:03.305507 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75574ca1-827d-4685-807f-27136ed28feb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:03.306178 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75574ca1-827d-4685-807f-27136ed28feb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:03.321041 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.objects.instance [None req-fdb75026-50a9-467a-99c8-96f514211960 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lazy-loading 'flavor' on Instance uuid 262867ad-b362-4696-9425-81751e68d74f {{(pid=116331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:10:03.388301 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-75574ca1-827d-4685-807f-27136ed28feb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 28210 microversion: 2.1 time: 0.095268 Nov 24 03:10:03.388988 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 404/829] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:03 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 28210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:10:03.405113 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-fdb75026-50a9-467a-99c8-96f514211960 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "POST /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f/action" status: 202 len: 0 microversion: 2.1 time: 0.130708 Nov 24 03:10:03.405806 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 426/830] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:03 2021] POST /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:10:03.415154 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d94878ab-1694-4d34-a66f-4cbd92ac32d1 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:03.415926 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d94878ab-1694-4d34-a66f-4cbd92ac32d1 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:03.423438 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d94878ab-1694-4d34-a66f-4cbd92ac32d1 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:03.423922 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d94878ab-1694-4d34-a66f-4cbd92ac32d1 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:03.424807 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d94878ab-1694-4d34-a66f-4cbd92ac32d1 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:03.425325 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d94878ab-1694-4d34-a66f-4cbd92ac32d1 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:03.485066 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-efda944c-1f30-4f3e-9f67-f5e2cbaa27b3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:03.486134 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-efda944c-1f30-4f3e-9f67-f5e2cbaa27b3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:03.492983 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-efda944c-1f30-4f3e-9f67-f5e2cbaa27b3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:03.493710 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-efda944c-1f30-4f3e-9f67-f5e2cbaa27b3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:03.494564 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-efda944c-1f30-4f3e-9f67-f5e2cbaa27b3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:03.494998 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-efda944c-1f30-4f3e-9f67-f5e2cbaa27b3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:03.594344 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d94878ab-1694-4d34-a66f-4cbd92ac32d1 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:03.602540 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d94878ab-1694-4d34-a66f-4cbd92ac32d1 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1571 microversion: 2.1 time: 0.191975 Nov 24 03:10:03.603186 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 405/831] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:03 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1571 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:10:03.661893 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-efda944c-1f30-4f3e-9f67-f5e2cbaa27b3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:03.676673 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-efda944c-1f30-4f3e-9f67-f5e2cbaa27b3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:03.679797 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-efda944c-1f30-4f3e-9f67-f5e2cbaa27b3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:03.681205 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-efda944c-1f30-4f3e-9f67-f5e2cbaa27b3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.201592 Nov 24 03:10:03.681797 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 427/832] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:03 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:10:04.401379 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a6cb6d0d-49cf-4b6e-a3a7-5d501fca3aab tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:04.402349 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a6cb6d0d-49cf-4b6e-a3a7-5d501fca3aab tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:04.409033 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a6cb6d0d-49cf-4b6e-a3a7-5d501fca3aab tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:04.409479 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a6cb6d0d-49cf-4b6e-a3a7-5d501fca3aab tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:04.410307 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a6cb6d0d-49cf-4b6e-a3a7-5d501fca3aab tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:04.410728 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a6cb6d0d-49cf-4b6e-a3a7-5d501fca3aab tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:04.472464 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a6cb6d0d-49cf-4b6e-a3a7-5d501fca3aab tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 28210 microversion: 2.1 time: 0.074807 Nov 24 03:10:04.473121 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 406/833] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:04 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 28210 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:10:04.621508 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-93c09ad9-14ef-4df5-93e0-ba15dfe21893 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:04.622167 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-93c09ad9-14ef-4df5-93e0-ba15dfe21893 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:04.629139 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-93c09ad9-14ef-4df5-93e0-ba15dfe21893 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:04.629563 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-93c09ad9-14ef-4df5-93e0-ba15dfe21893 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:04.630429 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-93c09ad9-14ef-4df5-93e0-ba15dfe21893 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:04.630862 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-93c09ad9-14ef-4df5-93e0-ba15dfe21893 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:04.701450 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d1ea2c9b-e1d9-4a9f-919e-416a84cea8a4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:04.702378 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d1ea2c9b-e1d9-4a9f-919e-416a84cea8a4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:04.709947 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d1ea2c9b-e1d9-4a9f-919e-416a84cea8a4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:04.710523 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d1ea2c9b-e1d9-4a9f-919e-416a84cea8a4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:04.711337 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d1ea2c9b-e1d9-4a9f-919e-416a84cea8a4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:04.711984 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d1ea2c9b-e1d9-4a9f-919e-416a84cea8a4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:04.800637 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-93c09ad9-14ef-4df5-93e0-ba15dfe21893 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:04.809434 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-93c09ad9-14ef-4df5-93e0-ba15dfe21893 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1571 microversion: 2.1 time: 0.191653 Nov 24 03:10:04.810068 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 428/834] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:04 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1571 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:04.856597 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d1ea2c9b-e1d9-4a9f-919e-416a84cea8a4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:04.864870 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d1ea2c9b-e1d9-4a9f-919e-416a84cea8a4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:04.866393 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d1ea2c9b-e1d9-4a9f-919e-416a84cea8a4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:04.868269 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d1ea2c9b-e1d9-4a9f-919e-416a84cea8a4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.172022 Nov 24 03:10:04.868844 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 407/835] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:04 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:10:05.484870 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-8959834d-5726-46f1-a0b9-b41e5ac2aa51 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:05.485794 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-8959834d-5726-46f1-a0b9-b41e5ac2aa51 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:05.492617 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8959834d-5726-46f1-a0b9-b41e5ac2aa51 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:05.493107 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8959834d-5726-46f1-a0b9-b41e5ac2aa51 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:05.494074 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8959834d-5726-46f1-a0b9-b41e5ac2aa51 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:05.494756 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8959834d-5726-46f1-a0b9-b41e5ac2aa51 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:05.578305 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-8959834d-5726-46f1-a0b9-b41e5ac2aa51 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 28501 microversion: 2.1 time: 0.097006 Nov 24 03:10:05.579032 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 429/836] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:05 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 28501 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:10:05.827002 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-07651c7a-35a8-4713-bc7e-15d7ff6d472a tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:05.829081 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-07651c7a-35a8-4713-bc7e-15d7ff6d472a tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:05.837053 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-07651c7a-35a8-4713-bc7e-15d7ff6d472a tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:05.837510 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-07651c7a-35a8-4713-bc7e-15d7ff6d472a tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:05.838372 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-07651c7a-35a8-4713-bc7e-15d7ff6d472a tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:05.838796 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-07651c7a-35a8-4713-bc7e-15d7ff6d472a tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:05.888180 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f225161b-1962-42df-80f5-6489769887d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:05.888885 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f225161b-1962-42df-80f5-6489769887d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:05.896801 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f225161b-1962-42df-80f5-6489769887d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:05.897235 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f225161b-1962-42df-80f5-6489769887d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:05.898144 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f225161b-1962-42df-80f5-6489769887d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:05.899273 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f225161b-1962-42df-80f5-6489769887d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:05.990496 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-07651c7a-35a8-4713-bc7e-15d7ff6d472a tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:05.998967 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-07651c7a-35a8-4713-bc7e-15d7ff6d472a tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1571 microversion: 2.1 time: 0.175909 Nov 24 03:10:05.999545 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 408/837] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:05 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1571 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:06.041672 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f225161b-1962-42df-80f5-6489769887d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:06.049712 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f225161b-1962-42df-80f5-6489769887d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:06.051234 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f225161b-1962-42df-80f5-6489769887d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:06.052418 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f225161b-1962-42df-80f5-6489769887d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.168504 Nov 24 03:10:06.052978 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 430/838] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:05 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:06.590740 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1b2a4e67-3c84-4f50-a866-a9c377e7ef7a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:06.591776 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1b2a4e67-3c84-4f50-a866-a9c377e7ef7a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:06.599410 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1b2a4e67-3c84-4f50-a866-a9c377e7ef7a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:06.599858 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1b2a4e67-3c84-4f50-a866-a9c377e7ef7a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:06.600642 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1b2a4e67-3c84-4f50-a866-a9c377e7ef7a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:06.601230 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1b2a4e67-3c84-4f50-a866-a9c377e7ef7a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:06.689712 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1b2a4e67-3c84-4f50-a866-a9c377e7ef7a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 28669 microversion: 2.1 time: 0.102574 Nov 24 03:10:06.690411 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 409/839] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:06 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 28669 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:10:07.017290 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-cc8bab09-702c-4a13-a190-a4212dcec6d7 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:07.017949 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-cc8bab09-702c-4a13-a190-a4212dcec6d7 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:07.025246 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cc8bab09-702c-4a13-a190-a4212dcec6d7 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:07.025696 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cc8bab09-702c-4a13-a190-a4212dcec6d7 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:07.026538 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cc8bab09-702c-4a13-a190-a4212dcec6d7 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:07.026947 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cc8bab09-702c-4a13-a190-a4212dcec6d7 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:07.072054 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-564884dd-af85-475e-ad84-09018b0ab510 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:07.072815 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-564884dd-af85-475e-ad84-09018b0ab510 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:07.080132 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-564884dd-af85-475e-ad84-09018b0ab510 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:07.080576 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-564884dd-af85-475e-ad84-09018b0ab510 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:07.081386 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-564884dd-af85-475e-ad84-09018b0ab510 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:07.081815 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-564884dd-af85-475e-ad84-09018b0ab510 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:07.183703 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-cc8bab09-702c-4a13-a190-a4212dcec6d7 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:07.191572 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-cc8bab09-702c-4a13-a190-a4212dcec6d7 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1571 microversion: 2.1 time: 0.178424 Nov 24 03:10:07.192617 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 431/840] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:07 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1571 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:07.260368 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-564884dd-af85-475e-ad84-09018b0ab510 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:07.270484 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-564884dd-af85-475e-ad84-09018b0ab510 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:07.271911 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-564884dd-af85-475e-ad84-09018b0ab510 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:07.273230 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-564884dd-af85-475e-ad84-09018b0ab510 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.205440 Nov 24 03:10:07.273825 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 410/841] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:07 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:07.702701 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7daf8db1-442a-4c25-979a-a976cca11464 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:07.703633 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-7daf8db1-442a-4c25-979a-a976cca11464 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:07.710612 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7daf8db1-442a-4c25-979a-a976cca11464 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:07.711055 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7daf8db1-442a-4c25-979a-a976cca11464 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:07.712375 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7daf8db1-442a-4c25-979a-a976cca11464 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:07.712375 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7daf8db1-442a-4c25-979a-a976cca11464 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:07.778095 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7daf8db1-442a-4c25-979a-a976cca11464 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 28669 microversion: 2.1 time: 0.078894 Nov 24 03:10:07.779052 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 432/842] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:07 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 28669 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:10:08.208667 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-555cced1-7d83-4835-a662-c5b20a1c362c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:08.209326 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-555cced1-7d83-4835-a662-c5b20a1c362c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:08.217414 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-555cced1-7d83-4835-a662-c5b20a1c362c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:08.217864 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-555cced1-7d83-4835-a662-c5b20a1c362c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:08.218701 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-555cced1-7d83-4835-a662-c5b20a1c362c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:08.219142 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-555cced1-7d83-4835-a662-c5b20a1c362c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:08.293076 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4f89c5e2-d15b-46b9-b6fe-bd456507479e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:08.293865 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4f89c5e2-d15b-46b9-b6fe-bd456507479e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:08.302091 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4f89c5e2-d15b-46b9-b6fe-bd456507479e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:08.302636 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4f89c5e2-d15b-46b9-b6fe-bd456507479e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:08.303512 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4f89c5e2-d15b-46b9-b6fe-bd456507479e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:08.304043 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4f89c5e2-d15b-46b9-b6fe-bd456507479e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:08.467319 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4f89c5e2-d15b-46b9-b6fe-bd456507479e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:08.476443 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4f89c5e2-d15b-46b9-b6fe-bd456507479e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:08.478060 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4f89c5e2-d15b-46b9-b6fe-bd456507479e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:08.479297 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4f89c5e2-d15b-46b9-b6fe-bd456507479e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.190757 Nov 24 03:10:08.479875 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 433/843] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:08 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:10:08.625328 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-555cced1-7d83-4835-a662-c5b20a1c362c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:08.635675 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-555cced1-7d83-4835-a662-c5b20a1c362c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1571 microversion: 2.1 time: 0.430798 Nov 24 03:10:08.636232 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 411/844] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:08 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1571 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:08.790282 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-22e78364-e44b-453c-a921-4dcdb4227892 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:08.791119 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-22e78364-e44b-453c-a921-4dcdb4227892 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:08.797835 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-22e78364-e44b-453c-a921-4dcdb4227892 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:08.798352 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-22e78364-e44b-453c-a921-4dcdb4227892 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:08.799148 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-22e78364-e44b-453c-a921-4dcdb4227892 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:08.799578 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-22e78364-e44b-453c-a921-4dcdb4227892 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:08.865132 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-22e78364-e44b-453c-a921-4dcdb4227892 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 28669 microversion: 2.1 time: 0.078674 Nov 24 03:10:08.865987 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 434/845] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:08 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 28669 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:10:09.506576 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-15c66c71-e74f-46e0-9dce-9f3947d367eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:09.507124 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-15c66c71-e74f-46e0-9dce-9f3947d367eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:09.514489 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15c66c71-e74f-46e0-9dce-9f3947d367eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:09.515099 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15c66c71-e74f-46e0-9dce-9f3947d367eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:09.516169 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15c66c71-e74f-46e0-9dce-9f3947d367eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:09.516774 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15c66c71-e74f-46e0-9dce-9f3947d367eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:09.653780 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-bdd862a0-7b13-48c1-ade6-9c64494e3592 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:09.654630 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-bdd862a0-7b13-48c1-ade6-9c64494e3592 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:09.661760 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bdd862a0-7b13-48c1-ade6-9c64494e3592 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:09.662045 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-15c66c71-e74f-46e0-9dce-9f3947d367eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:09.662234 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bdd862a0-7b13-48c1-ade6-9c64494e3592 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:09.663002 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bdd862a0-7b13-48c1-ade6-9c64494e3592 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:09.663527 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bdd862a0-7b13-48c1-ade6-9c64494e3592 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:09.671065 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-15c66c71-e74f-46e0-9dce-9f3947d367eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:09.672869 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-15c66c71-e74f-46e0-9dce-9f3947d367eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:09.674391 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-15c66c71-e74f-46e0-9dce-9f3947d367eb tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.172250 Nov 24 03:10:09.674957 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 412/846] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:09 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:09.808788 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-bdd862a0-7b13-48c1-ade6-9c64494e3592 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:09.816675 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-bdd862a0-7b13-48c1-ade6-9c64494e3592 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1571 microversion: 2.1 time: 0.166984 Nov 24 03:10:09.817258 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 435/847] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:09 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:10:09.877978 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6b2842bd-1522-4f04-9dcd-33c7a51289a1 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:09.879150 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6b2842bd-1522-4f04-9dcd-33c7a51289a1 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:09.886136 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b2842bd-1522-4f04-9dcd-33c7a51289a1 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:09.886585 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b2842bd-1522-4f04-9dcd-33c7a51289a1 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:09.887374 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b2842bd-1522-4f04-9dcd-33c7a51289a1 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:09.887814 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b2842bd-1522-4f04-9dcd-33c7a51289a1 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:09.973483 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6b2842bd-1522-4f04-9dcd-33c7a51289a1 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 28694 microversion: 2.1 time: 0.099041 Nov 24 03:10:09.974191 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 413/848] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:09 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 28694 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:10:10.692211 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-00962c25-5190-4aca-b682-773e0d7a7450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:10.692794 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-00962c25-5190-4aca-b682-773e0d7a7450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:10.700113 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-00962c25-5190-4aca-b682-773e0d7a7450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:10.700646 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-00962c25-5190-4aca-b682-773e0d7a7450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:10.701360 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-00962c25-5190-4aca-b682-773e0d7a7450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:10.701792 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-00962c25-5190-4aca-b682-773e0d7a7450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:10.837509 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9fb94ee3-5d2c-4a58-8c70-248a7ae00c9d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:10.839048 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9fb94ee3-5d2c-4a58-8c70-248a7ae00c9d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:10.847345 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9fb94ee3-5d2c-4a58-8c70-248a7ae00c9d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:10.847784 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9fb94ee3-5d2c-4a58-8c70-248a7ae00c9d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:10.848626 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9fb94ee3-5d2c-4a58-8c70-248a7ae00c9d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:10.849060 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9fb94ee3-5d2c-4a58-8c70-248a7ae00c9d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:10.858752 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-00962c25-5190-4aca-b682-773e0d7a7450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:10.866798 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-00962c25-5190-4aca-b682-773e0d7a7450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:10.869248 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-00962c25-5190-4aca-b682-773e0d7a7450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:10.870489 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-00962c25-5190-4aca-b682-773e0d7a7450 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.182064 Nov 24 03:10:10.871061 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 436/849] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:10 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:10.988218 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5006f4c6-98cd-40e8-908c-3dd440138bcf tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:10.989055 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-5006f4c6-98cd-40e8-908c-3dd440138bcf tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:10.994218 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9fb94ee3-5d2c-4a58-8c70-248a7ae00c9d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:10.995776 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5006f4c6-98cd-40e8-908c-3dd440138bcf tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:10.996235 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5006f4c6-98cd-40e8-908c-3dd440138bcf tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:10.997028 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5006f4c6-98cd-40e8-908c-3dd440138bcf tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:10.997449 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5006f4c6-98cd-40e8-908c-3dd440138bcf tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:11.002081 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9fb94ee3-5d2c-4a58-8c70-248a7ae00c9d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1571 microversion: 2.1 time: 0.170964 Nov 24 03:10:11.002691 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 414/850] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:10 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:11.078928 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-5006f4c6-98cd-40e8-908c-3dd440138bcf tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 30794 microversion: 2.1 time: 0.096399 Nov 24 03:10:11.079886 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 437/851] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:10 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 30794 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 03:10:11.889492 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-54ecf050-a87d-44d2-9f1e-148183171a18 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:11.890686 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-54ecf050-a87d-44d2-9f1e-148183171a18 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:11.897944 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-54ecf050-a87d-44d2-9f1e-148183171a18 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:11.898404 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-54ecf050-a87d-44d2-9f1e-148183171a18 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:11.899196 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-54ecf050-a87d-44d2-9f1e-148183171a18 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:11.899651 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-54ecf050-a87d-44d2-9f1e-148183171a18 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:12.020373 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-a8769f6a-80ec-435d-8386-1785c669253f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:12.021071 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-a8769f6a-80ec-435d-8386-1785c669253f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:12.028248 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a8769f6a-80ec-435d-8386-1785c669253f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:12.028687 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a8769f6a-80ec-435d-8386-1785c669253f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:12.029476 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a8769f6a-80ec-435d-8386-1785c669253f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:12.029901 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a8769f6a-80ec-435d-8386-1785c669253f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:12.048983 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-54ecf050-a87d-44d2-9f1e-148183171a18 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:12.056948 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-54ecf050-a87d-44d2-9f1e-148183171a18 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:12.058465 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-54ecf050-a87d-44d2-9f1e-148183171a18 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:12.059625 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-54ecf050-a87d-44d2-9f1e-148183171a18 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.175139 Nov 24 03:10:12.060186 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 415/852] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:11 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:12.091084 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-16ec0e16-8b72-4118-b68a-5d47c2e94274 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:12.091994 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-16ec0e16-8b72-4118-b68a-5d47c2e94274 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:12.098105 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16ec0e16-8b72-4118-b68a-5d47c2e94274 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:12.098555 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16ec0e16-8b72-4118-b68a-5d47c2e94274 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:12.099360 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16ec0e16-8b72-4118-b68a-5d47c2e94274 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:12.099787 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16ec0e16-8b72-4118-b68a-5d47c2e94274 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:12.172499 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-a8769f6a-80ec-435d-8386-1785c669253f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:12.177593 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-16ec0e16-8b72-4118-b68a-5d47c2e94274 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 32666 microversion: 2.1 time: 0.090012 Nov 24 03:10:12.178305 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 416/853] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:12 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 32666 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 03:10:12.184575 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-a8769f6a-80ec-435d-8386-1785c669253f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1571 microversion: 2.1 time: 0.168186 Nov 24 03:10:12.185139 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 438/854] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:12 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1571 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:10:13.079993 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a1872e4d-6f61-4e42-965f-026682769c61 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:13.080687 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a1872e4d-6f61-4e42-965f-026682769c61 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:13.090366 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a1872e4d-6f61-4e42-965f-026682769c61 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:13.090829 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a1872e4d-6f61-4e42-965f-026682769c61 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:13.092979 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a1872e4d-6f61-4e42-965f-026682769c61 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:13.092979 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a1872e4d-6f61-4e42-965f-026682769c61 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:13.189727 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7e28deb4-e36a-4223-aa36-2099e6ff4f13 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:13.190682 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-7e28deb4-e36a-4223-aa36-2099e6ff4f13 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:13.199246 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7e28deb4-e36a-4223-aa36-2099e6ff4f13 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:13.199694 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7e28deb4-e36a-4223-aa36-2099e6ff4f13 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:13.200499 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7e28deb4-e36a-4223-aa36-2099e6ff4f13 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:13.200955 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7e28deb4-e36a-4223-aa36-2099e6ff4f13 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:13.241793 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a1872e4d-6f61-4e42-965f-026682769c61 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:13.250032 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a1872e4d-6f61-4e42-965f-026682769c61 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:13.251576 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a1872e4d-6f61-4e42-965f-026682769c61 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:13.252776 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a1872e4d-6f61-4e42-965f-026682769c61 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.177364 Nov 24 03:10:13.253325 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 417/855] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:13 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:13.257764 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e6506bb4-494f-40cb-b03b-ef333a32077d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:13.258396 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e6506bb4-494f-40cb-b03b-ef333a32077d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:13.265956 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e6506bb4-494f-40cb-b03b-ef333a32077d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:13.266418 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e6506bb4-494f-40cb-b03b-ef333a32077d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:13.267239 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e6506bb4-494f-40cb-b03b-ef333a32077d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:13.267672 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e6506bb4-494f-40cb-b03b-ef333a32077d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:13.278727 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7e28deb4-e36a-4223-aa36-2099e6ff4f13 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 33660 microversion: 2.1 time: 0.092774 Nov 24 03:10:13.283013 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 439/856] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:13 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 33660 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:10:13.408974 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e6506bb4-494f-40cb-b03b-ef333a32077d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:13.417170 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e6506bb4-494f-40cb-b03b-ef333a32077d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1571 microversion: 2.1 time: 0.162813 Nov 24 03:10:13.417780 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 418/857] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:13 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:14.272626 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b8ed44e5-c6a0-47ff-9a10-68ab7aab4ab4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:14.273317 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b8ed44e5-c6a0-47ff-9a10-68ab7aab4ab4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:14.280914 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b8ed44e5-c6a0-47ff-9a10-68ab7aab4ab4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:14.281361 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b8ed44e5-c6a0-47ff-9a10-68ab7aab4ab4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:14.282205 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b8ed44e5-c6a0-47ff-9a10-68ab7aab4ab4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:14.282652 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b8ed44e5-c6a0-47ff-9a10-68ab7aab4ab4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:14.291761 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-99beaf55-cd11-4f67-8c92-48a8240be358 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:14.292686 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-99beaf55-cd11-4f67-8c92-48a8240be358 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:14.299847 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-99beaf55-cd11-4f67-8c92-48a8240be358 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:14.300287 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-99beaf55-cd11-4f67-8c92-48a8240be358 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:14.301077 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-99beaf55-cd11-4f67-8c92-48a8240be358 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:14.301500 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-99beaf55-cd11-4f67-8c92-48a8240be358 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:14.378012 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-99beaf55-cd11-4f67-8c92-48a8240be358 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 34802 microversion: 2.1 time: 0.089450 Nov 24 03:10:14.383195 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 419/858] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:14 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 34802 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 03:10:14.434011 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b8ed44e5-c6a0-47ff-9a10-68ab7aab4ab4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:14.435359 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1e89e459-0b30-4df9-9a45-9343a98e4201 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:14.436068 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1e89e459-0b30-4df9-9a45-9343a98e4201 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:14.443745 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1e89e459-0b30-4df9-9a45-9343a98e4201 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:14.443942 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b8ed44e5-c6a0-47ff-9a10-68ab7aab4ab4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:14.444110 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1e89e459-0b30-4df9-9a45-9343a98e4201 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:14.444906 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1e89e459-0b30-4df9-9a45-9343a98e4201 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:14.445244 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b8ed44e5-c6a0-47ff-9a10-68ab7aab4ab4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:14.445417 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1e89e459-0b30-4df9-9a45-9343a98e4201 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:14.446909 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b8ed44e5-c6a0-47ff-9a10-68ab7aab4ab4 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.178645 Nov 24 03:10:14.447713 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 440/859] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:14 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:14.597554 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1e89e459-0b30-4df9-9a45-9343a98e4201 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:14.607037 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1e89e459-0b30-4df9-9a45-9343a98e4201 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1571 microversion: 2.1 time: 0.175905 Nov 24 03:10:14.607636 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 420/860] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:14 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1571 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:15.390980 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b35dc0ed-ef10-493d-9dde-03261bf78729 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:15.391899 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b35dc0ed-ef10-493d-9dde-03261bf78729 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:15.398476 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b35dc0ed-ef10-493d-9dde-03261bf78729 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:15.398922 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b35dc0ed-ef10-493d-9dde-03261bf78729 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:15.399684 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b35dc0ed-ef10-493d-9dde-03261bf78729 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:15.400105 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b35dc0ed-ef10-493d-9dde-03261bf78729 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:15.464800 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-81b55a00-723f-45fe-b389-0f6d45768ab0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:15.465548 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-81b55a00-723f-45fe-b389-0f6d45768ab0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:15.472395 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-81b55a00-723f-45fe-b389-0f6d45768ab0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:15.472864 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-81b55a00-723f-45fe-b389-0f6d45768ab0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:15.473498 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b35dc0ed-ef10-493d-9dde-03261bf78729 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 35694 microversion: 2.1 time: 0.086685 Nov 24 03:10:15.473695 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-81b55a00-723f-45fe-b389-0f6d45768ab0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:15.474170 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-81b55a00-723f-45fe-b389-0f6d45768ab0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:15.474293 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 441/861] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:15 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 35694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:10:15.618140 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-81b55a00-723f-45fe-b389-0f6d45768ab0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:15.627123 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-81b55a00-723f-45fe-b389-0f6d45768ab0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:15.628423 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-bc9a4a3a-ce95-484c-b662-110994cac7cd tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:15.628605 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-81b55a00-723f-45fe-b389-0f6d45768ab0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:15.629116 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-bc9a4a3a-ce95-484c-b662-110994cac7cd tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:15.629799 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-81b55a00-723f-45fe-b389-0f6d45768ab0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.168981 Nov 24 03:10:15.630429 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 421/862] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:15 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:15.637682 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bc9a4a3a-ce95-484c-b662-110994cac7cd tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:15.637682 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bc9a4a3a-ce95-484c-b662-110994cac7cd tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:15.637682 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bc9a4a3a-ce95-484c-b662-110994cac7cd tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:15.638117 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bc9a4a3a-ce95-484c-b662-110994cac7cd tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:15.784740 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-bc9a4a3a-ce95-484c-b662-110994cac7cd tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:15.792576 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-bc9a4a3a-ce95-484c-b662-110994cac7cd tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1571 microversion: 2.1 time: 0.168092 Nov 24 03:10:15.793230 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 442/863] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:15 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1571 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:10:16.485346 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7df9ac23-1cbc-4ebf-ab12-c63c318ab5f6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:16.486284 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7df9ac23-1cbc-4ebf-ab12-c63c318ab5f6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:16.493384 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7df9ac23-1cbc-4ebf-ab12-c63c318ab5f6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:16.493841 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7df9ac23-1cbc-4ebf-ab12-c63c318ab5f6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:16.494669 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7df9ac23-1cbc-4ebf-ab12-c63c318ab5f6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:16.495103 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7df9ac23-1cbc-4ebf-ab12-c63c318ab5f6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:16.585449 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7df9ac23-1cbc-4ebf-ab12-c63c318ab5f6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 36915 microversion: 2.1 time: 0.103495 Nov 24 03:10:16.586510 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 422/864] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:16 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 36915 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:10:16.649116 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-a118b35f-3e30-47cc-a011-bcc7e3dd5028 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:16.649798 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-a118b35f-3e30-47cc-a011-bcc7e3dd5028 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:16.657402 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a118b35f-3e30-47cc-a011-bcc7e3dd5028 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:16.657855 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a118b35f-3e30-47cc-a011-bcc7e3dd5028 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:16.658733 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a118b35f-3e30-47cc-a011-bcc7e3dd5028 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:16.659163 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a118b35f-3e30-47cc-a011-bcc7e3dd5028 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:16.802479 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-a118b35f-3e30-47cc-a011-bcc7e3dd5028 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:16.810668 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-a118b35f-3e30-47cc-a011-bcc7e3dd5028 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:16.812170 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-a118b35f-3e30-47cc-a011-bcc7e3dd5028 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:16.813358 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-a118b35f-3e30-47cc-a011-bcc7e3dd5028 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.168293 Nov 24 03:10:16.814077 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 443/865] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:16 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:16.819257 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3ca67fbd-22e4-4970-b4c8-9d56fa7eff9c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:16.819966 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3ca67fbd-22e4-4970-b4c8-9d56fa7eff9c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:16.827430 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3ca67fbd-22e4-4970-b4c8-9d56fa7eff9c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:16.827881 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3ca67fbd-22e4-4970-b4c8-9d56fa7eff9c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:16.828688 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3ca67fbd-22e4-4970-b4c8-9d56fa7eff9c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:16.829123 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3ca67fbd-22e4-4970-b4c8-9d56fa7eff9c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:16.976971 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3ca67fbd-22e4-4970-b4c8-9d56fa7eff9c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:16.985693 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3ca67fbd-22e4-4970-b4c8-9d56fa7eff9c tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1512 microversion: 2.1 time: 0.170395 Nov 24 03:10:16.986287 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 423/866] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:16 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:17.005808 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b8f01dae-3146-4be3-b3c2-bce969b57f92 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:17.006328 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b8f01dae-3146-4be3-b3c2-bce969b57f92 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:17.012964 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b8f01dae-3146-4be3-b3c2-bce969b57f92 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:17.013529 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b8f01dae-3146-4be3-b3c2-bce969b57f92 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:17.014346 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b8f01dae-3146-4be3-b3c2-bce969b57f92 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:17.014787 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b8f01dae-3146-4be3-b3c2-bce969b57f92 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:17.116800 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b8f01dae-3146-4be3-b3c2-bce969b57f92 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "POST /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f/action" status: 202 len: 0 microversion: 2.1 time: 0.114769 Nov 24 03:10:17.117435 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 444/867] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:17 2021] POST /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:10:17.128978 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7886e6aa-6a67-4e5c-b138-f008c6be045b tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:17.129708 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7886e6aa-6a67-4e5c-b138-f008c6be045b tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:17.136722 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7886e6aa-6a67-4e5c-b138-f008c6be045b tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:17.137143 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7886e6aa-6a67-4e5c-b138-f008c6be045b tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:17.138051 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7886e6aa-6a67-4e5c-b138-f008c6be045b tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:17.138411 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7886e6aa-6a67-4e5c-b138-f008c6be045b tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:17.287863 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7886e6aa-6a67-4e5c-b138-f008c6be045b tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:17.302201 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7886e6aa-6a67-4e5c-b138-f008c6be045b tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1520 microversion: 2.1 time: 0.178650 Nov 24 03:10:17.302985 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 424/868] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:17 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:17.598110 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ffc46d3d-cc77-46ac-9557-d88cd1753afb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:17.599059 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ffc46d3d-cc77-46ac-9557-d88cd1753afb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:17.605978 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ffc46d3d-cc77-46ac-9557-d88cd1753afb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:17.606432 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ffc46d3d-cc77-46ac-9557-d88cd1753afb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:17.608093 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ffc46d3d-cc77-46ac-9557-d88cd1753afb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:17.608521 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ffc46d3d-cc77-46ac-9557-d88cd1753afb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:17.689377 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ffc46d3d-cc77-46ac-9557-d88cd1753afb tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 38198 microversion: 2.1 time: 0.095299 Nov 24 03:10:17.690855 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 445/869] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:17 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 38198 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:10:17.832098 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-55ea9085-2b65-473f-8051-21ed4a24cd76 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:17.832803 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-55ea9085-2b65-473f-8051-21ed4a24cd76 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:17.839507 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-55ea9085-2b65-473f-8051-21ed4a24cd76 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:17.839964 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-55ea9085-2b65-473f-8051-21ed4a24cd76 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:17.840782 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-55ea9085-2b65-473f-8051-21ed4a24cd76 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:17.841345 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-55ea9085-2b65-473f-8051-21ed4a24cd76 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:17.996367 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-55ea9085-2b65-473f-8051-21ed4a24cd76 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:18.005281 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-55ea9085-2b65-473f-8051-21ed4a24cd76 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:18.007025 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-55ea9085-2b65-473f-8051-21ed4a24cd76 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:18.008226 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-55ea9085-2b65-473f-8051-21ed4a24cd76 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.180140 Nov 24 03:10:18.008794 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 425/870] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:17 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:18.324478 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ab08de96-c9ea-4917-9557-16093bcc14e4 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:18.325878 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ab08de96-c9ea-4917-9557-16093bcc14e4 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:18.333501 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ab08de96-c9ea-4917-9557-16093bcc14e4 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:18.334092 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ab08de96-c9ea-4917-9557-16093bcc14e4 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:18.335064 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ab08de96-c9ea-4917-9557-16093bcc14e4 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:18.335550 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ab08de96-c9ea-4917-9557-16093bcc14e4 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:18.477567 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ab08de96-c9ea-4917-9557-16093bcc14e4 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:18.485881 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ab08de96-c9ea-4917-9557-16093bcc14e4 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1578 microversion: 2.1 time: 0.165926 Nov 24 03:10:18.486600 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 446/871] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:18 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:18.702569 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-812fb0f6-9bae-4dc6-9617-76249e50056b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:18.703425 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-812fb0f6-9bae-4dc6-9617-76249e50056b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:18.710253 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-812fb0f6-9bae-4dc6-9617-76249e50056b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:18.710709 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-812fb0f6-9bae-4dc6-9617-76249e50056b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:18.711538 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-812fb0f6-9bae-4dc6-9617-76249e50056b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:18.711992 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-812fb0f6-9bae-4dc6-9617-76249e50056b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:18.774744 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-812fb0f6-9bae-4dc6-9617-76249e50056b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 38198 microversion: 2.1 time: 0.076188 Nov 24 03:10:18.775835 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 426/872] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:18 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 38198 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:10:19.030406 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0a9cdfdc-30a4-47cf-9760-254b5e1c74d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:19.031269 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0a9cdfdc-30a4-47cf-9760-254b5e1c74d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:19.038238 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a9cdfdc-30a4-47cf-9760-254b5e1c74d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:19.038685 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a9cdfdc-30a4-47cf-9760-254b5e1c74d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:19.039519 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a9cdfdc-30a4-47cf-9760-254b5e1c74d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:19.039955 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0a9cdfdc-30a4-47cf-9760-254b5e1c74d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:19.186457 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0a9cdfdc-30a4-47cf-9760-254b5e1c74d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:19.195036 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0a9cdfdc-30a4-47cf-9760-254b5e1c74d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:19.196564 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0a9cdfdc-30a4-47cf-9760-254b5e1c74d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:19.197746 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0a9cdfdc-30a4-47cf-9760-254b5e1c74d3 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1743 microversion: 2.20 time: 0.171330 Nov 24 03:10:19.198386 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 447/873] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:19 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:19.505612 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bd0f8bbd-ee81-4757-b317-4d2fe0d41493 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:19.506630 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bd0f8bbd-ee81-4757-b317-4d2fe0d41493 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:19.516150 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bd0f8bbd-ee81-4757-b317-4d2fe0d41493 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:19.516710 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bd0f8bbd-ee81-4757-b317-4d2fe0d41493 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:19.517572 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bd0f8bbd-ee81-4757-b317-4d2fe0d41493 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:19.518079 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bd0f8bbd-ee81-4757-b317-4d2fe0d41493 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:19.676485 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-bd0f8bbd-ee81-4757-b317-4d2fe0d41493 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:19.684222 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bd0f8bbd-ee81-4757-b317-4d2fe0d41493 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1578 microversion: 2.1 time: 0.182750 Nov 24 03:10:19.684947 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 427/874] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:19 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1578 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:19.758792 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-71a4c9c2-a5a1-4473-965f-6e2c51cd46dd req-ba82aca0-11c8-4a09-937d-0aa296b08dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262867ad-b362-4696-9425-81751e68d74f", "name": "network-vif-unplugged", "status": "completed", "tag": "74c8f067-ea92-4a51-9064-326e74424693"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:19.760554 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:10:19.760554 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:10:19.768974 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-71a4c9c2-a5a1-4473-965f-6e2c51cd46dd req-ba82aca0-11c8-4a09-937d-0aa296b08dbd service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:19.769654 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-71a4c9c2-a5a1-4473-965f-6e2c51cd46dd req-ba82aca0-11c8-4a09-937d-0aa296b08dbd service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:19.782033 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-71a4c9c2-a5a1-4473-965f-6e2c51cd46dd req-ba82aca0-11c8-4a09-937d-0aa296b08dbd service nova] Creating event network-vif-unplugged:74c8f067-ea92-4a51-9064-326e74424693 for instance 262867ad-b362-4696-9425-81751e68d74f on hv-cinder-81803 Nov 24 03:10:19.787309 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-71a4c9c2-a5a1-4473-965f-6e2c51cd46dd req-ba82aca0-11c8-4a09-937d-0aa296b08dbd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032270 Nov 24 03:10:19.788359 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 448/875] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:10:19 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:10:19.847507 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-01fd8a36-20aa-45a1-b313-9ddaea560ca6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:19.849304 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-01fd8a36-20aa-45a1-b313-9ddaea560ca6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:19.855606 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-01fd8a36-20aa-45a1-b313-9ddaea560ca6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:19.856146 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-01fd8a36-20aa-45a1-b313-9ddaea560ca6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:19.857016 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-01fd8a36-20aa-45a1-b313-9ddaea560ca6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:19.857572 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-01fd8a36-20aa-45a1-b313-9ddaea560ca6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:19.925216 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-01fd8a36-20aa-45a1-b313-9ddaea560ca6 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 38198 microversion: 2.1 time: 0.140614 Nov 24 03:10:19.925860 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 428/876] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:19 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 38198 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:10:20.218774 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4d13c592-65df-48f2-b58d-c367f32948d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:20.219609 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4d13c592-65df-48f2-b58d-c367f32948d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:20.226900 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4d13c592-65df-48f2-b58d-c367f32948d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:20.227395 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4d13c592-65df-48f2-b58d-c367f32948d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:20.228183 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4d13c592-65df-48f2-b58d-c367f32948d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:20.228611 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4d13c592-65df-48f2-b58d-c367f32948d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:20.386416 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4d13c592-65df-48f2-b58d-c367f32948d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:20.396398 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4d13c592-65df-48f2-b58d-c367f32948d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:20.397907 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4d13c592-65df-48f2-b58d-c367f32948d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:20.399108 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4d13c592-65df-48f2-b58d-c367f32948d7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1743 microversion: 2.20 time: 0.185842 Nov 24 03:10:20.399679 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 449/877] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:20 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1743 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:20.711065 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c00eac16-74f7-4b5a-b0e0-c3cf70588a76 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:20.711942 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c00eac16-74f7-4b5a-b0e0-c3cf70588a76 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:20.719292 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c00eac16-74f7-4b5a-b0e0-c3cf70588a76 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:20.719737 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c00eac16-74f7-4b5a-b0e0-c3cf70588a76 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:20.720618 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c00eac16-74f7-4b5a-b0e0-c3cf70588a76 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:20.720940 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c00eac16-74f7-4b5a-b0e0-c3cf70588a76 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:20.863607 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c00eac16-74f7-4b5a-b0e0-c3cf70588a76 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:20.871128 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c00eac16-74f7-4b5a-b0e0-c3cf70588a76 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1578 microversion: 2.1 time: 0.164379 Nov 24 03:10:20.871701 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 429/878] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:20 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:20.936878 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-a44536dc-12c8-40fd-9ecf-bcda74f127ce tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:20.937876 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-a44536dc-12c8-40fd-9ecf-bcda74f127ce tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:20.944248 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a44536dc-12c8-40fd-9ecf-bcda74f127ce tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:20.944706 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a44536dc-12c8-40fd-9ecf-bcda74f127ce tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:20.945492 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a44536dc-12c8-40fd-9ecf-bcda74f127ce tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:20.945946 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a44536dc-12c8-40fd-9ecf-bcda74f127ce tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:21.018623 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-a44536dc-12c8-40fd-9ecf-bcda74f127ce tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 38272 microversion: 2.1 time: 0.085425 Nov 24 03:10:21.019980 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 450/879] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:20 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 38272 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:10:21.417015 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6f112b2b-1aee-4a70-90a8-33b211375799 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:21.417604 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6f112b2b-1aee-4a70-90a8-33b211375799 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:21.425293 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f112b2b-1aee-4a70-90a8-33b211375799 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:21.425748 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f112b2b-1aee-4a70-90a8-33b211375799 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:21.426598 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f112b2b-1aee-4a70-90a8-33b211375799 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:21.427040 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f112b2b-1aee-4a70-90a8-33b211375799 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:21.583274 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6f112b2b-1aee-4a70-90a8-33b211375799 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:21.595479 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6f112b2b-1aee-4a70-90a8-33b211375799 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:21.598278 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6f112b2b-1aee-4a70-90a8-33b211375799 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:21.600080 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6f112b2b-1aee-4a70-90a8-33b211375799 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1738 microversion: 2.20 time: 0.187106 Nov 24 03:10:21.607664 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 430/880] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:21 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:21.821434 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-4c2239f5-b6ed-4569-86ef-7df4ea49a4ac req-5317eb50-ea78-435c-a55d-60bb89d1a7ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c38b798-2640-427f-915e-9a40f83e3b6e", "name": "network-vif-plugged", "status": "completed", "tag": "2e14e194-347c-4bad-a3ce-d09d56be7ce1"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:21.823226 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:10:21.823226 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:10:21.832553 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-4c2239f5-b6ed-4569-86ef-7df4ea49a4ac req-5317eb50-ea78-435c-a55d-60bb89d1a7ee service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:21.833349 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-4c2239f5-b6ed-4569-86ef-7df4ea49a4ac req-5317eb50-ea78-435c-a55d-60bb89d1a7ee service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:21.846320 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-4c2239f5-b6ed-4569-86ef-7df4ea49a4ac req-5317eb50-ea78-435c-a55d-60bb89d1a7ee service nova] Creating event network-vif-plugged:2e14e194-347c-4bad-a3ce-d09d56be7ce1 for instance 5c38b798-2640-427f-915e-9a40f83e3b6e on hv-cinder-81803 Nov 24 03:10:21.851242 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-4c2239f5-b6ed-4569-86ef-7df4ea49a4ac req-5317eb50-ea78-435c-a55d-60bb89d1a7ee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034702 Nov 24 03:10:21.852397 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 451/881] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:10:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:10:21.888756 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4d947f11-1cd9-488b-b67f-e5b8956ebcdb tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:21.890139 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4d947f11-1cd9-488b-b67f-e5b8956ebcdb tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:21.897093 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4d947f11-1cd9-488b-b67f-e5b8956ebcdb tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:21.897545 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4d947f11-1cd9-488b-b67f-e5b8956ebcdb tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:21.898384 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4d947f11-1cd9-488b-b67f-e5b8956ebcdb tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:21.898818 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4d947f11-1cd9-488b-b67f-e5b8956ebcdb tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:22.034124 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5a9c1c07-6551-4af2-9e4f-4767453d4f4e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:22.035467 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-5a9c1c07-6551-4af2-9e4f-4767453d4f4e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:22.045703 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5a9c1c07-6551-4af2-9e4f-4767453d4f4e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:22.047243 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5a9c1c07-6551-4af2-9e4f-4767453d4f4e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:22.048581 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5a9c1c07-6551-4af2-9e4f-4767453d4f4e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:22.049188 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5a9c1c07-6551-4af2-9e4f-4767453d4f4e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:22.111544 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4d947f11-1cd9-488b-b67f-e5b8956ebcdb tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:22.119761 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4d947f11-1cd9-488b-b67f-e5b8956ebcdb tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1578 microversion: 2.1 time: 0.234938 Nov 24 03:10:22.120658 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 431/882] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:21 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1578 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:22.134903 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-5a9c1c07-6551-4af2-9e4f-4767453d4f4e tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action" status: 200 len: 38327 microversion: 2.1 time: 0.106409 Nov 24 03:10:22.135973 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 452/883] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Nov 24 03:10:22 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/action => generated 38327 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:10:22.146182 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-85c4cd7a-e8aa-4085-89c6-5abf93f84039 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:22.146966 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-85c4cd7a-e8aa-4085-89c6-5abf93f84039 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:22.153345 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-85c4cd7a-e8aa-4085-89c6-5abf93f84039 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:22.154082 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-85c4cd7a-e8aa-4085-89c6-5abf93f84039 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:22.155125 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-85c4cd7a-e8aa-4085-89c6-5abf93f84039 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:22.155725 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-85c4cd7a-e8aa-4085-89c6-5abf93f84039 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:22.182609 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-85c4cd7a-e8aa-4085-89c6-5abf93f84039 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/ips" status: 200 len: 145 microversion: 2.1 time: 0.040080 Nov 24 03:10:22.183496 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 432/884] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Nov 24 03:10:22 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:10:22.619995 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-74fda88c-64e3-4c04-b718-b4b9c518893d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:22.620746 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-74fda88c-64e3-4c04-b718-b4b9c518893d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:22.629170 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-74fda88c-64e3-4c04-b718-b4b9c518893d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:22.629617 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-74fda88c-64e3-4c04-b718-b4b9c518893d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:22.630442 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-74fda88c-64e3-4c04-b718-b4b9c518893d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:22.631056 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-74fda88c-64e3-4c04-b718-b4b9c518893d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:22.792151 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-74fda88c-64e3-4c04-b718-b4b9c518893d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:22.801752 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-74fda88c-64e3-4c04-b718-b4b9c518893d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:22.803595 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-74fda88c-64e3-4c04-b718-b4b9c518893d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:22.804939 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-74fda88c-64e3-4c04-b718-b4b9c518893d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1738 microversion: 2.20 time: 0.189397 Nov 24 03:10:22.805749 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 453/885] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:22 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:23.137107 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c2a22838-0623-4e8b-aa9c-c50b3db557f0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:23.137726 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c2a22838-0623-4e8b-aa9c-c50b3db557f0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:23.144798 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2a22838-0623-4e8b-aa9c-c50b3db557f0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:23.145243 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2a22838-0623-4e8b-aa9c-c50b3db557f0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:23.146058 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2a22838-0623-4e8b-aa9c-c50b3db557f0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:23.146669 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2a22838-0623-4e8b-aa9c-c50b3db557f0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:23.314337 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c2a22838-0623-4e8b-aa9c-c50b3db557f0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:23.322744 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c2a22838-0623-4e8b-aa9c-c50b3db557f0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1578 microversion: 2.1 time: 0.189266 Nov 24 03:10:23.323455 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 433/886] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:23 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1578 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:23.547887 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-40c1e1fe-6525-47f4-b037-e259056b0f58 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47b8f43c-5cb2-4347-8e9d-c3e89e5353a3"}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:23.549064 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-40c1e1fe-6525-47f4-b037-e259056b0f58 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:23.558827 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-40c1e1fe-6525-47f4-b037-e259056b0f58 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:23.559887 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-40c1e1fe-6525-47f4-b037-e259056b0f58 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:23.561155 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-40c1e1fe-6525-47f4-b037-e259056b0f58 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:23.561806 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-40c1e1fe-6525-47f4-b037-e259056b0f58 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:23.823823 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-edbabe3d-4268-4c69-82f0-848bcb3d98ff tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:23.824543 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-edbabe3d-4268-4c69-82f0-848bcb3d98ff tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:23.832003 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-edbabe3d-4268-4c69-82f0-848bcb3d98ff tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:23.832551 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-edbabe3d-4268-4c69-82f0-848bcb3d98ff tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:23.832889 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-40c1e1fe-6525-47f4-b037-e259056b0f58 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288966 Nov 24 03:10:23.833842 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-edbabe3d-4268-4c69-82f0-848bcb3d98ff tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:23.833991 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 454/887] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Nov 24 03:10:23 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:10:23.834092 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-edbabe3d-4268-4c69-82f0-848bcb3d98ff tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:24.016477 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-edbabe3d-4268-4c69-82f0-848bcb3d98ff tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:24.029406 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-edbabe3d-4268-4c69-82f0-848bcb3d98ff tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:24.031979 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-edbabe3d-4268-4c69-82f0-848bcb3d98ff tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:24.034248 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-edbabe3d-4268-4c69-82f0-848bcb3d98ff tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1738 microversion: 2.20 time: 0.214149 Nov 24 03:10:24.034960 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 434/888] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:23 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:10:24.341737 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-10df9f4c-6d0c-4ad2-99c3-8fffed09cd06 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:24.342456 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-10df9f4c-6d0c-4ad2-99c3-8fffed09cd06 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:24.349624 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-10df9f4c-6d0c-4ad2-99c3-8fffed09cd06 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:24.350101 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-10df9f4c-6d0c-4ad2-99c3-8fffed09cd06 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:24.351144 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-10df9f4c-6d0c-4ad2-99c3-8fffed09cd06 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:24.351831 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-10df9f4c-6d0c-4ad2-99c3-8fffed09cd06 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:24.513701 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-10df9f4c-6d0c-4ad2-99c3-8fffed09cd06 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:24.524933 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-10df9f4c-6d0c-4ad2-99c3-8fffed09cd06 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1578 microversion: 2.1 time: 0.187730 Nov 24 03:10:24.525748 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 455/889] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:24 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1578 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:25.052873 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-98ff3e27-4188-4b99-bd91-11fc04c10680 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:25.053629 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-98ff3e27-4188-4b99-bd91-11fc04c10680 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:25.061187 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-98ff3e27-4188-4b99-bd91-11fc04c10680 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:25.061725 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-98ff3e27-4188-4b99-bd91-11fc04c10680 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:25.062814 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-98ff3e27-4188-4b99-bd91-11fc04c10680 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:25.063453 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-98ff3e27-4188-4b99-bd91-11fc04c10680 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:25.242991 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-98ff3e27-4188-4b99-bd91-11fc04c10680 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:25.259060 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-98ff3e27-4188-4b99-bd91-11fc04c10680 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:25.260708 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-98ff3e27-4188-4b99-bd91-11fc04c10680 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:25.262178 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-98ff3e27-4188-4b99-bd91-11fc04c10680 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1738 microversion: 2.20 time: 0.213136 Nov 24 03:10:25.264664 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 435/890] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:25 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:25.543000 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-530689ba-1698-4e17-a4d6-3ff34a35bce0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:25.543597 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-530689ba-1698-4e17-a4d6-3ff34a35bce0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:25.554462 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-530689ba-1698-4e17-a4d6-3ff34a35bce0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:25.555308 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-530689ba-1698-4e17-a4d6-3ff34a35bce0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:25.556375 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-530689ba-1698-4e17-a4d6-3ff34a35bce0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:25.556869 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-530689ba-1698-4e17-a4d6-3ff34a35bce0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:25.735848 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-530689ba-1698-4e17-a4d6-3ff34a35bce0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:25.744362 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-530689ba-1698-4e17-a4d6-3ff34a35bce0 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1578 microversion: 2.1 time: 0.205037 Nov 24 03:10:25.745161 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 456/891] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:25 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1578 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:26.282930 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1ffa07c2-8d1f-4bea-b62a-3268ec2ea260 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:26.284165 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1ffa07c2-8d1f-4bea-b62a-3268ec2ea260 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:26.299565 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1ffa07c2-8d1f-4bea-b62a-3268ec2ea260 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:26.300218 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1ffa07c2-8d1f-4bea-b62a-3268ec2ea260 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:26.301810 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1ffa07c2-8d1f-4bea-b62a-3268ec2ea260 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:26.302279 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1ffa07c2-8d1f-4bea-b62a-3268ec2ea260 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:26.502190 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1ffa07c2-8d1f-4bea-b62a-3268ec2ea260 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:26.517254 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1ffa07c2-8d1f-4bea-b62a-3268ec2ea260 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:26.519345 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1ffa07c2-8d1f-4bea-b62a-3268ec2ea260 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:26.520734 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1ffa07c2-8d1f-4bea-b62a-3268ec2ea260 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1738 microversion: 2.20 time: 0.242198 Nov 24 03:10:26.534486 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 436/892] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:26 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:26.762025 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-8e91af5f-a085-4c41-a815-457a08f0185d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:26.762652 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-8e91af5f-a085-4c41-a815-457a08f0185d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:26.770420 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8e91af5f-a085-4c41-a815-457a08f0185d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:26.770871 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8e91af5f-a085-4c41-a815-457a08f0185d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:26.771711 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8e91af5f-a085-4c41-a815-457a08f0185d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:26.772216 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8e91af5f-a085-4c41-a815-457a08f0185d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:26.941354 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-8e91af5f-a085-4c41-a815-457a08f0185d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:26.951139 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-8e91af5f-a085-4c41-a815-457a08f0185d tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1565 microversion: 2.1 time: 0.192820 Nov 24 03:10:26.952100 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 457/893] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:26 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1565 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:27.542016 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ddb3695c-94f4-49b1-af81-ea837105094c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:27.542787 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ddb3695c-94f4-49b1-af81-ea837105094c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:27.549509 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ddb3695c-94f4-49b1-af81-ea837105094c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:27.550020 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ddb3695c-94f4-49b1-af81-ea837105094c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:27.550785 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ddb3695c-94f4-49b1-af81-ea837105094c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:27.551472 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ddb3695c-94f4-49b1-af81-ea837105094c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:27.703657 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ddb3695c-94f4-49b1-af81-ea837105094c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:27.711896 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ddb3695c-94f4-49b1-af81-ea837105094c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:27.713930 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ddb3695c-94f4-49b1-af81-ea837105094c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:27.715352 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ddb3695c-94f4-49b1-af81-ea837105094c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1738 microversion: 2.20 time: 0.177447 Nov 24 03:10:27.730001 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 437/894] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:27 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:28.734980 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f72faa1b-9449-499e-b6c1-b4b4fef74679 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:28.735585 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f72faa1b-9449-499e-b6c1-b4b4fef74679 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:28.742340 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f72faa1b-9449-499e-b6c1-b4b4fef74679 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:28.742881 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f72faa1b-9449-499e-b6c1-b4b4fef74679 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:28.743917 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f72faa1b-9449-499e-b6c1-b4b4fef74679 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:28.744548 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f72faa1b-9449-499e-b6c1-b4b4fef74679 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:28.905212 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f72faa1b-9449-499e-b6c1-b4b4fef74679 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:28.913520 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f72faa1b-9449-499e-b6c1-b4b4fef74679 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:28.915019 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f72faa1b-9449-499e-b6c1-b4b4fef74679 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:28.917344 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f72faa1b-9449-499e-b6c1-b4b4fef74679 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1738 microversion: 2.20 time: 0.185430 Nov 24 03:10:28.919198 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 458/895] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:28 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:29.834200 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-d0c6393d-f749-4c1a-8e87-065536168e51 req-2ed528f6-04b1-46af-b1eb-c766e6fd144f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262867ad-b362-4696-9425-81751e68d74f", "name": "network-vif-plugged", "status": "completed", "tag": "74c8f067-ea92-4a51-9064-326e74424693"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:29.837066 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:10:29.837066 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:10:29.853072 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-d0c6393d-f749-4c1a-8e87-065536168e51 req-2ed528f6-04b1-46af-b1eb-c766e6fd144f service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:29.853515 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-d0c6393d-f749-4c1a-8e87-065536168e51 req-2ed528f6-04b1-46af-b1eb-c766e6fd144f service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:29.865808 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-d0c6393d-f749-4c1a-8e87-065536168e51 req-2ed528f6-04b1-46af-b1eb-c766e6fd144f service nova] Creating event network-vif-plugged:74c8f067-ea92-4a51-9064-326e74424693 for instance 262867ad-b362-4696-9425-81751e68d74f on hv-cinder-81803 Nov 24 03:10:29.871465 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-d0c6393d-f749-4c1a-8e87-065536168e51 req-2ed528f6-04b1-46af-b1eb-c766e6fd144f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044285 Nov 24 03:10:29.873155 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 438/896] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:10:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:10:29.937960 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7dde0eea-bbeb-4676-8e75-bb6c4a1df67e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:29.939397 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-7dde0eea-bbeb-4676-8e75-bb6c4a1df67e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:29.946158 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7dde0eea-bbeb-4676-8e75-bb6c4a1df67e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:29.946616 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7dde0eea-bbeb-4676-8e75-bb6c4a1df67e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:29.947417 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7dde0eea-bbeb-4676-8e75-bb6c4a1df67e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:29.947872 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7dde0eea-bbeb-4676-8e75-bb6c4a1df67e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:30.103758 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7dde0eea-bbeb-4676-8e75-bb6c4a1df67e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:30.115231 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7dde0eea-bbeb-4676-8e75-bb6c4a1df67e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:30.116726 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7dde0eea-bbeb-4676-8e75-bb6c4a1df67e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:30.118750 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7dde0eea-bbeb-4676-8e75-bb6c4a1df67e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1738 microversion: 2.20 time: 0.185559 Nov 24 03:10:30.130459 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 459/897] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:29 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:30.354866 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e859938a-ef31-41b2-a3b7-9098dfb44ec8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:30.356268 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e859938a-ef31-41b2-a3b7-9098dfb44ec8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:30.363361 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e859938a-ef31-41b2-a3b7-9098dfb44ec8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:30.364154 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e859938a-ef31-41b2-a3b7-9098dfb44ec8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:30.365176 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e859938a-ef31-41b2-a3b7-9098dfb44ec8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:30.365689 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e859938a-ef31-41b2-a3b7-9098dfb44ec8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:30.402338 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e859938a-ef31-41b2-a3b7-9098dfb44ec8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051356 Nov 24 03:10:30.403009 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 439/898] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Nov 24 03:10:30 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:10:30.414532 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f664d3fb-b5e5-4825-a914-b99eb2278525 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:30.415365 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f664d3fb-b5e5-4825-a914-b99eb2278525 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:30.422113 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f664d3fb-b5e5-4825-a914-b99eb2278525 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:30.422556 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f664d3fb-b5e5-4825-a914-b99eb2278525 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:30.423374 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f664d3fb-b5e5-4825-a914-b99eb2278525 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:30.423797 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f664d3fb-b5e5-4825-a914-b99eb2278525 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:30.455985 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f664d3fb-b5e5-4825-a914-b99eb2278525 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments/47b8f43c-5cb2-4347-8e9d-c3e89e5353a3" status: 200 len: 194 microversion: 2.1 time: 0.045622 Nov 24 03:10:30.456958 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 460/899] 10.222.0.52 () {58 vars in 1412 bytes} [Wed Nov 24 03:10:30 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments/47b8f43c-5cb2-4347-8e9d-c3e89e5353a3 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:10:30.894792 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 03:10:30.895394 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: Wed Nov 24 03:10:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 03:10:31.137694 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7d6370bc-b0f4-4992-be89-31c643147607 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:31.138547 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7d6370bc-b0f4-4992-be89-31c643147607 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:31.153177 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d6370bc-b0f4-4992-be89-31c643147607 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:31.153632 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d6370bc-b0f4-4992-be89-31c643147607 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:31.154965 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d6370bc-b0f4-4992-be89-31c643147607 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:31.155426 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d6370bc-b0f4-4992-be89-31c643147607 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:31.357239 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7d6370bc-b0f4-4992-be89-31c643147607 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:31.366477 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7d6370bc-b0f4-4992-be89-31c643147607 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:31.368815 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7d6370bc-b0f4-4992-be89-31c643147607 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:31.370717 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7d6370bc-b0f4-4992-be89-31c643147607 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1720 microversion: 2.20 time: 0.236541 Nov 24 03:10:31.371540 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 440/900] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:31 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1720 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:31.835912 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-cb6d911d-d72d-4d4e-9d5e-9aaa5c771d5f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45eccb87-8d8e-47d3-8933-aae79383fd92"}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:31.837079 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-cb6d911d-d72d-4d4e-9d5e-9aaa5c771d5f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:31.844413 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb6d911d-d72d-4d4e-9d5e-9aaa5c771d5f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:31.844868 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb6d911d-d72d-4d4e-9d5e-9aaa5c771d5f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:31.845663 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb6d911d-d72d-4d4e-9d5e-9aaa5c771d5f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:31.846129 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb6d911d-d72d-4d4e-9d5e-9aaa5c771d5f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:32.121451 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-cb6d911d-d72d-4d4e-9d5e-9aaa5c771d5f tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289172 Nov 24 03:10:32.122110 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 461/901] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Nov 24 03:10:31 2021] POST /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:10:32.393346 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1c1522b0-4fc8-4505-8a6d-a9ea0b52b4f2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:32.393973 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1c1522b0-4fc8-4505-8a6d-a9ea0b52b4f2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:32.400772 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1c1522b0-4fc8-4505-8a6d-a9ea0b52b4f2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:32.401249 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1c1522b0-4fc8-4505-8a6d-a9ea0b52b4f2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:32.402078 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1c1522b0-4fc8-4505-8a6d-a9ea0b52b4f2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:32.402518 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1c1522b0-4fc8-4505-8a6d-a9ea0b52b4f2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:32.550109 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1c1522b0-4fc8-4505-8a6d-a9ea0b52b4f2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:32.558683 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1c1522b0-4fc8-4505-8a6d-a9ea0b52b4f2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:32.560567 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1c1522b0-4fc8-4505-8a6d-a9ea0b52b4f2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:32.561856 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1c1522b0-4fc8-4505-8a6d-a9ea0b52b4f2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1720 microversion: 2.20 time: 0.172717 Nov 24 03:10:32.562446 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 441/902] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:32 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:33.581527 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-8b55934d-f129-4348-aee2-73e67cb93008 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:33.582239 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-8b55934d-f129-4348-aee2-73e67cb93008 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:33.589000 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8b55934d-f129-4348-aee2-73e67cb93008 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:33.589453 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8b55934d-f129-4348-aee2-73e67cb93008 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:33.590277 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8b55934d-f129-4348-aee2-73e67cb93008 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:33.590716 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8b55934d-f129-4348-aee2-73e67cb93008 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:33.740001 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-8b55934d-f129-4348-aee2-73e67cb93008 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:33.748181 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-8b55934d-f129-4348-aee2-73e67cb93008 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:33.750003 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-8b55934d-f129-4348-aee2-73e67cb93008 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:33.751401 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-8b55934d-f129-4348-aee2-73e67cb93008 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1723 microversion: 2.20 time: 0.174651 Nov 24 03:10:33.751959 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 462/903] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:33 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:33.769727 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-84345f3f-7223-4de5-a23a-239ace8ea07c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dda6b2ed-82da-414d-95a6-f0ee6b966926"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:33.770813 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-84345f3f-7223-4de5-a23a-239ace8ea07c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:33.777134 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-84345f3f-7223-4de5-a23a-239ace8ea07c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:33.777577 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-84345f3f-7223-4de5-a23a-239ace8ea07c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:33.778422 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-84345f3f-7223-4de5-a23a-239ace8ea07c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:33.778846 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-84345f3f-7223-4de5-a23a-239ace8ea07c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:34.065052 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-84345f3f-7223-4de5-a23a-239ace8ea07c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299633 Nov 24 03:10:34.065670 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 442/904] 10.222.0.52 () {62 vars in 1363 bytes} [Wed Nov 24 03:10:33 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 03:10:34.183037 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f5d4c721-8e91-4522-99bf-13369119792e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:34.183497 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f5d4c721-8e91-4522-99bf-13369119792e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:34.190314 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f5d4c721-8e91-4522-99bf-13369119792e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:34.190758 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f5d4c721-8e91-4522-99bf-13369119792e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:34.191534 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f5d4c721-8e91-4522-99bf-13369119792e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:34.191963 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f5d4c721-8e91-4522-99bf-13369119792e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:34.439987 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f5d4c721-8e91-4522-99bf-13369119792e tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/os-volume_attachments/dda6b2ed-82da-414d-95a6-f0ee6b966926" status: 202 len: 0 microversion: 2.20 time: 0.260949 Nov 24 03:10:34.440625 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 463/905] 10.222.0.52 () {60 vars in 1456 bytes} [Wed Nov 24 03:10:34 2021] DELETE /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/os-volume_attachments/dda6b2ed-82da-414d-95a6-f0ee6b966926 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:10:34.499634 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2063904b-8022-4ac6-909d-baf4133e28b7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:34.500105 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2063904b-8022-4ac6-909d-baf4133e28b7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:34.506415 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2063904b-8022-4ac6-909d-baf4133e28b7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:34.506870 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2063904b-8022-4ac6-909d-baf4133e28b7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:34.507661 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2063904b-8022-4ac6-909d-baf4133e28b7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:34.508098 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2063904b-8022-4ac6-909d-baf4133e28b7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:34.596613 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2063904b-8022-4ac6-909d-baf4133e28b7 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action" status: 202 len: 0 microversion: 2.20 time: 0.100775 Nov 24 03:10:34.597240 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 443/906] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Nov 24 03:10:34 2021] POST /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:10:34.605583 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-37f129f3-1a9d-4a8a-b90b-5873be515ba5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:34.606189 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-37f129f3-1a9d-4a8a-b90b-5873be515ba5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:34.612980 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-37f129f3-1a9d-4a8a-b90b-5873be515ba5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:34.613515 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-37f129f3-1a9d-4a8a-b90b-5873be515ba5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:34.614405 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-37f129f3-1a9d-4a8a-b90b-5873be515ba5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:34.614902 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-37f129f3-1a9d-4a8a-b90b-5873be515ba5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:34.752376 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-37f129f3-1a9d-4a8a-b90b-5873be515ba5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:34.760737 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-37f129f3-1a9d-4a8a-b90b-5873be515ba5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:34.762289 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-37f129f3-1a9d-4a8a-b90b-5873be515ba5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:34.763544 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-37f129f3-1a9d-4a8a-b90b-5873be515ba5 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1671 microversion: 2.20 time: 0.161992 Nov 24 03:10:34.764100 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 464/907] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:34 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:35.766904 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-4b733cf5-5b87-4ab9-ba23-aae37998da7d req-6fc28fb2-db4e-4d38-a4cd-13d09fe52e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c38b798-2640-427f-915e-9a40f83e3b6e", "name": "network-vif-unplugged", "status": "completed", "tag": "2e14e194-347c-4bad-a3ce-d09d56be7ce1"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:35.768712 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:10:35.768712 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:10:35.776952 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-4b733cf5-5b87-4ab9-ba23-aae37998da7d req-6fc28fb2-db4e-4d38-a4cd-13d09fe52e8b service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:35.777536 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-4b733cf5-5b87-4ab9-ba23-aae37998da7d req-6fc28fb2-db4e-4d38-a4cd-13d09fe52e8b service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:35.783735 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-9e3e7441-6f2b-487a-af03-70a2772754a0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:35.784342 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-9e3e7441-6f2b-487a-af03-70a2772754a0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:35.790922 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9e3e7441-6f2b-487a-af03-70a2772754a0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:35.791371 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9e3e7441-6f2b-487a-af03-70a2772754a0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:35.791927 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-4b733cf5-5b87-4ab9-ba23-aae37998da7d req-6fc28fb2-db4e-4d38-a4cd-13d09fe52e8b service nova] Creating event network-vif-unplugged:2e14e194-347c-4bad-a3ce-d09d56be7ce1 for instance 5c38b798-2640-427f-915e-9a40f83e3b6e on hv-cinder-81803 Nov 24 03:10:35.792157 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9e3e7441-6f2b-487a-af03-70a2772754a0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:35.792626 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9e3e7441-6f2b-487a-af03-70a2772754a0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:35.797082 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-4b733cf5-5b87-4ab9-ba23-aae37998da7d req-6fc28fb2-db4e-4d38-a4cd-13d09fe52e8b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034731 Nov 24 03:10:35.798336 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 444/908] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:10:35 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:10:35.939472 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-9e3e7441-6f2b-487a-af03-70a2772754a0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:35.948526 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-9e3e7441-6f2b-487a-af03-70a2772754a0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:35.950093 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-9e3e7441-6f2b-487a-af03-70a2772754a0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:35.951292 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-9e3e7441-6f2b-487a-af03-70a2772754a0 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1729 microversion: 2.20 time: 0.172604 Nov 24 03:10:35.951877 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 465/909] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:35 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:36.973942 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8d69e2eb-e485-4af8-89b4-db7bbdc1f9bc tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:36.975732 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8d69e2eb-e485-4af8-89b4-db7bbdc1f9bc tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:36.990082 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8d69e2eb-e485-4af8-89b4-db7bbdc1f9bc tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:36.990558 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8d69e2eb-e485-4af8-89b4-db7bbdc1f9bc tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:36.991552 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8d69e2eb-e485-4af8-89b4-db7bbdc1f9bc tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:36.994951 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8d69e2eb-e485-4af8-89b4-db7bbdc1f9bc tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:37.160368 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8d69e2eb-e485-4af8-89b4-db7bbdc1f9bc tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:37.169502 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8d69e2eb-e485-4af8-89b4-db7bbdc1f9bc tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:37.171413 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8d69e2eb-e485-4af8-89b4-db7bbdc1f9bc tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:37.173249 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8d69e2eb-e485-4af8-89b4-db7bbdc1f9bc tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1729 microversion: 2.20 time: 0.204981 Nov 24 03:10:37.173897 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 445/910] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:36 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:38.192726 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-3a99424b-9732-4588-abff-f3aa32850527 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:38.193419 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-3a99424b-9732-4588-abff-f3aa32850527 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:38.200090 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3a99424b-9732-4588-abff-f3aa32850527 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:38.200614 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3a99424b-9732-4588-abff-f3aa32850527 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:38.201506 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3a99424b-9732-4588-abff-f3aa32850527 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:38.202022 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-3a99424b-9732-4588-abff-f3aa32850527 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:38.376803 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-3a99424b-9732-4588-abff-f3aa32850527 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:38.386432 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-3a99424b-9732-4588-abff-f3aa32850527 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:38.388243 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-3a99424b-9732-4588-abff-f3aa32850527 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:38.389443 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-3a99424b-9732-4588-abff-f3aa32850527 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1729 microversion: 2.20 time: 0.201190 Nov 24 03:10:38.390356 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 466/911] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:38 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:39.414369 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-916ab6ed-7887-4da5-8153-c8744bf1ea9d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:39.415110 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-916ab6ed-7887-4da5-8153-c8744bf1ea9d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:39.425369 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-916ab6ed-7887-4da5-8153-c8744bf1ea9d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:39.425946 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-916ab6ed-7887-4da5-8153-c8744bf1ea9d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:39.426871 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-916ab6ed-7887-4da5-8153-c8744bf1ea9d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:39.427307 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-916ab6ed-7887-4da5-8153-c8744bf1ea9d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:39.579845 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-916ab6ed-7887-4da5-8153-c8744bf1ea9d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:39.588236 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-916ab6ed-7887-4da5-8153-c8744bf1ea9d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:39.590035 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-916ab6ed-7887-4da5-8153-c8744bf1ea9d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:39.591225 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-916ab6ed-7887-4da5-8153-c8744bf1ea9d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1729 microversion: 2.20 time: 0.180891 Nov 24 03:10:39.591760 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 446/912] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:39 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:40.608457 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2e88e238-3b38-43aa-9b53-4be1e982da22 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:40.609397 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2e88e238-3b38-43aa-9b53-4be1e982da22 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:40.615884 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2e88e238-3b38-43aa-9b53-4be1e982da22 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:40.616326 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2e88e238-3b38-43aa-9b53-4be1e982da22 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:40.617125 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2e88e238-3b38-43aa-9b53-4be1e982da22 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:40.617565 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2e88e238-3b38-43aa-9b53-4be1e982da22 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:40.778355 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2e88e238-3b38-43aa-9b53-4be1e982da22 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:40.788058 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2e88e238-3b38-43aa-9b53-4be1e982da22 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:40.789625 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2e88e238-3b38-43aa-9b53-4be1e982da22 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:40.793328 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2e88e238-3b38-43aa-9b53-4be1e982da22 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1729 microversion: 2.20 time: 0.186120 Nov 24 03:10:40.793328 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 467/913] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:40 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:41.810168 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6b7848c9-f132-432e-ba53-9f144c8ca8ca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:41.810770 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6b7848c9-f132-432e-ba53-9f144c8ca8ca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:41.817737 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b7848c9-f132-432e-ba53-9f144c8ca8ca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:41.818222 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b7848c9-f132-432e-ba53-9f144c8ca8ca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:41.819012 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b7848c9-f132-432e-ba53-9f144c8ca8ca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:41.819444 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b7848c9-f132-432e-ba53-9f144c8ca8ca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:41.981279 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6b7848c9-f132-432e-ba53-9f144c8ca8ca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:41.990220 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6b7848c9-f132-432e-ba53-9f144c8ca8ca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:41.991714 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6b7848c9-f132-432e-ba53-9f144c8ca8ca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:41.992899 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6b7848c9-f132-432e-ba53-9f144c8ca8ca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1729 microversion: 2.20 time: 0.186764 Nov 24 03:10:41.993451 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 447/914] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:41 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:10:43.011948 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-572b1196-6a01-46f6-8872-e1ff3ebed5f8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:43.013272 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-572b1196-6a01-46f6-8872-e1ff3ebed5f8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:43.022907 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-572b1196-6a01-46f6-8872-e1ff3ebed5f8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:43.023496 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-572b1196-6a01-46f6-8872-e1ff3ebed5f8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:43.024580 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-572b1196-6a01-46f6-8872-e1ff3ebed5f8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:43.025425 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-572b1196-6a01-46f6-8872-e1ff3ebed5f8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:43.174549 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-572b1196-6a01-46f6-8872-e1ff3ebed5f8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:43.183332 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-572b1196-6a01-46f6-8872-e1ff3ebed5f8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:43.184934 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-572b1196-6a01-46f6-8872-e1ff3ebed5f8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:43.186656 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-572b1196-6a01-46f6-8872-e1ff3ebed5f8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1729 microversion: 2.20 time: 0.178088 Nov 24 03:10:43.187175 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 468/915] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:43 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:10:44.211130 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6c58f65b-2889-43f5-ac5b-696a38e5b96d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:44.211789 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6c58f65b-2889-43f5-ac5b-696a38e5b96d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:44.219375 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c58f65b-2889-43f5-ac5b-696a38e5b96d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:44.220028 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c58f65b-2889-43f5-ac5b-696a38e5b96d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:44.221484 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c58f65b-2889-43f5-ac5b-696a38e5b96d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:44.222497 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c58f65b-2889-43f5-ac5b-696a38e5b96d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:44.378494 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6c58f65b-2889-43f5-ac5b-696a38e5b96d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:44.387702 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6c58f65b-2889-43f5-ac5b-696a38e5b96d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:44.389178 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6c58f65b-2889-43f5-ac5b-696a38e5b96d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:44.390878 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6c58f65b-2889-43f5-ac5b-696a38e5b96d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1729 microversion: 2.20 time: 0.189220 Nov 24 03:10:44.391536 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 448/916] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:44 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:45.423219 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-477f9c10-11b0-4297-be72-e57863af1013 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:45.424494 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-477f9c10-11b0-4297-be72-e57863af1013 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:45.435335 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-477f9c10-11b0-4297-be72-e57863af1013 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:45.436231 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-477f9c10-11b0-4297-be72-e57863af1013 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:45.437645 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-477f9c10-11b0-4297-be72-e57863af1013 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:45.438512 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-477f9c10-11b0-4297-be72-e57863af1013 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:45.616971 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-477f9c10-11b0-4297-be72-e57863af1013 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:45.625421 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-477f9c10-11b0-4297-be72-e57863af1013 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:45.627014 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-477f9c10-11b0-4297-be72-e57863af1013 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:45.628373 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-477f9c10-11b0-4297-be72-e57863af1013 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1729 microversion: 2.20 time: 0.210156 Nov 24 03:10:45.628941 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 469/917] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:45 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1729 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:46.650750 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f9a5d2b1-9c9b-4b43-acb8-318ab36c0d1c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:46.662377 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f9a5d2b1-9c9b-4b43-acb8-318ab36c0d1c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:46.670262 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f9a5d2b1-9c9b-4b43-acb8-318ab36c0d1c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:46.671196 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f9a5d2b1-9c9b-4b43-acb8-318ab36c0d1c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:46.672530 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f9a5d2b1-9c9b-4b43-acb8-318ab36c0d1c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:46.673818 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f9a5d2b1-9c9b-4b43-acb8-318ab36c0d1c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:46.849772 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f9a5d2b1-9c9b-4b43-acb8-318ab36c0d1c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:46.860015 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f9a5d2b1-9c9b-4b43-acb8-318ab36c0d1c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:46.864818 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f9a5d2b1-9c9b-4b43-acb8-318ab36c0d1c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:46.867155 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f9a5d2b1-9c9b-4b43-acb8-318ab36c0d1c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1729 microversion: 2.20 time: 0.222462 Nov 24 03:10:46.867777 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 449/918] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:46 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:47.886803 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e855a431-0c25-49fa-8076-0e283c869eca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:47.887529 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e855a431-0c25-49fa-8076-0e283c869eca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:47.895604 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e855a431-0c25-49fa-8076-0e283c869eca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:47.896070 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e855a431-0c25-49fa-8076-0e283c869eca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:47.896921 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e855a431-0c25-49fa-8076-0e283c869eca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:47.897706 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e855a431-0c25-49fa-8076-0e283c869eca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:48.078233 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e855a431-0c25-49fa-8076-0e283c869eca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:48.087050 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e855a431-0c25-49fa-8076-0e283c869eca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:48.088613 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-e855a431-0c25-49fa-8076-0e283c869eca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:48.089876 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e855a431-0c25-49fa-8076-0e283c869eca tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1729 microversion: 2.20 time: 0.206932 Nov 24 03:10:48.090849 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 470/919] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:47 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:10:49.109386 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-92a32679-78f8-41a7-94a6-4e071be09598 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:49.110173 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-92a32679-78f8-41a7-94a6-4e071be09598 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:49.117569 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-92a32679-78f8-41a7-94a6-4e071be09598 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:49.118059 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-92a32679-78f8-41a7-94a6-4e071be09598 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:49.118876 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-92a32679-78f8-41a7-94a6-4e071be09598 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:49.119343 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-92a32679-78f8-41a7-94a6-4e071be09598 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:49.216716 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ce74505e-2bf5-4332-89d7-df786953d7e8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:49.218041 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ce74505e-2bf5-4332-89d7-df786953d7e8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:49.225830 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ce74505e-2bf5-4332-89d7-df786953d7e8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:49.226337 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ce74505e-2bf5-4332-89d7-df786953d7e8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:49.227167 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ce74505e-2bf5-4332-89d7-df786953d7e8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:49.228082 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ce74505e-2bf5-4332-89d7-df786953d7e8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:49.264101 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ce74505e-2bf5-4332-89d7-df786953d7e8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051560 Nov 24 03:10:49.264719 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 471/920] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Nov 24 03:10:49 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:10:49.285745 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-92a32679-78f8-41a7-94a6-4e071be09598 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:49.294391 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-92a32679-78f8-41a7-94a6-4e071be09598 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:49.295872 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-92a32679-78f8-41a7-94a6-4e071be09598 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:49.297100 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-92a32679-78f8-41a7-94a6-4e071be09598 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1729 microversion: 2.20 time: 0.191851 Nov 24 03:10:49.297683 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 450/921] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:49 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:49.508230 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c0c79fc6-a564-4008-9f5a-ff6e5b26c5ec tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:49.508702 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c0c79fc6-a564-4008-9f5a-ff6e5b26c5ec tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:49.516094 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c0c79fc6-a564-4008-9f5a-ff6e5b26c5ec tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:49.516543 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c0c79fc6-a564-4008-9f5a-ff6e5b26c5ec tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:49.518170 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c0c79fc6-a564-4008-9f5a-ff6e5b26c5ec tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:49.518648 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c0c79fc6-a564-4008-9f5a-ff6e5b26c5ec tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:49.552983 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c0c79fc6-a564-4008-9f5a-ff6e5b26c5ec tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments/47b8f43c-5cb2-4347-8e9d-c3e89e5353a3" status: 200 len: 194 microversion: 2.1 time: 0.048642 Nov 24 03:10:49.553589 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 472/922] 10.222.0.52 () {58 vars in 1412 bytes} [Wed Nov 24 03:10:49 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments/47b8f43c-5cb2-4347-8e9d-c3e89e5353a3 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:10:49.563702 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-97c2fe85-20a1-4b23-a7c5-aad4e2d636d4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:49.564274 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-97c2fe85-20a1-4b23-a7c5-aad4e2d636d4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:49.570775 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-97c2fe85-20a1-4b23-a7c5-aad4e2d636d4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:49.571231 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-97c2fe85-20a1-4b23-a7c5-aad4e2d636d4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:49.572022 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-97c2fe85-20a1-4b23-a7c5-aad4e2d636d4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:49.572454 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-97c2fe85-20a1-4b23-a7c5-aad4e2d636d4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:49.656772 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-97c2fe85-20a1-4b23-a7c5-aad4e2d636d4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lazy-loading 'services' on Instance uuid e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:10:49.743158 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-97c2fe85-20a1-4b23-a7c5-aad4e2d636d4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments/47b8f43c-5cb2-4347-8e9d-c3e89e5353a3" status: 202 len: 0 microversion: 2.1 time: 0.182725 Nov 24 03:10:49.743826 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 451/923] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Nov 24 03:10:49 2021] DELETE /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments/47b8f43c-5cb2-4347-8e9d-c3e89e5353a3 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:10:50.318687 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4102d32d-5a02-4948-8904-70c97e0a6717 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:50.319270 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4102d32d-5a02-4948-8904-70c97e0a6717 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:50.326217 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4102d32d-5a02-4948-8904-70c97e0a6717 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:50.326660 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4102d32d-5a02-4948-8904-70c97e0a6717 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:50.327833 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4102d32d-5a02-4948-8904-70c97e0a6717 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:50.328445 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4102d32d-5a02-4948-8904-70c97e0a6717 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:50.488547 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4102d32d-5a02-4948-8904-70c97e0a6717 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:50.501007 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4102d32d-5a02-4948-8904-70c97e0a6717 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:50.503518 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4102d32d-5a02-4948-8904-70c97e0a6717 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:50.504702 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4102d32d-5a02-4948-8904-70c97e0a6717 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1729 microversion: 2.20 time: 0.190497 Nov 24 03:10:50.505339 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 473/924] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:50 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:50.884500 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b82d2d05-c84d-423c-a313-db5c2d03b838 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:50.885226 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b82d2d05-c84d-423c-a313-db5c2d03b838 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:50.891950 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b82d2d05-c84d-423c-a313-db5c2d03b838 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:50.892508 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b82d2d05-c84d-423c-a313-db5c2d03b838 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:50.893309 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b82d2d05-c84d-423c-a313-db5c2d03b838 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:50.893762 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b82d2d05-c84d-423c-a313-db5c2d03b838 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:50.924779 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b82d2d05-c84d-423c-a313-db5c2d03b838 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments/45eccb87-8d8e-47d3-8933-aae79383fd92" status: 200 len: 194 microversion: 2.1 time: 0.045166 Nov 24 03:10:50.925397 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 452/925] 10.222.0.52 () {58 vars in 1412 bytes} [Wed Nov 24 03:10:50 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments/45eccb87-8d8e-47d3-8933-aae79383fd92 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:10:50.935071 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-d2a1a031-869d-46be-ba6d-4d5ad1854b9c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:50.935562 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-d2a1a031-869d-46be-ba6d-4d5ad1854b9c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:50.941886 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d2a1a031-869d-46be-ba6d-4d5ad1854b9c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:50.942368 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d2a1a031-869d-46be-ba6d-4d5ad1854b9c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:50.943152 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d2a1a031-869d-46be-ba6d-4d5ad1854b9c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:50.943576 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d2a1a031-869d-46be-ba6d-4d5ad1854b9c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:51.030373 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.objects.instance [None req-d2a1a031-869d-46be-ba6d-4d5ad1854b9c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lazy-loading 'services' on Instance uuid e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d {{(pid=116331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:10:51.107105 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-d2a1a031-869d-46be-ba6d-4d5ad1854b9c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments/45eccb87-8d8e-47d3-8933-aae79383fd92" status: 202 len: 0 microversion: 2.1 time: 0.175327 Nov 24 03:10:51.107913 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 474/926] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Nov 24 03:10:50 2021] DELETE /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments/45eccb87-8d8e-47d3-8933-aae79383fd92 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 03:10:51.529644 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-93de2808-8c3f-4d80-be63-b166dd4e2f46 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:51.530803 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-93de2808-8c3f-4d80-be63-b166dd4e2f46 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:51.540930 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-93de2808-8c3f-4d80-be63-b166dd4e2f46 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:51.541789 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-93de2808-8c3f-4d80-be63-b166dd4e2f46 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:51.543236 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-93de2808-8c3f-4d80-be63-b166dd4e2f46 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:51.544030 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-93de2808-8c3f-4d80-be63-b166dd4e2f46 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:51.712408 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-93de2808-8c3f-4d80-be63-b166dd4e2f46 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:51.720654 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-93de2808-8c3f-4d80-be63-b166dd4e2f46 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:51.722219 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-93de2808-8c3f-4d80-be63-b166dd4e2f46 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:51.723386 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-93de2808-8c3f-4d80-be63-b166dd4e2f46 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1729 microversion: 2.20 time: 0.200972 Nov 24 03:10:51.723953 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 453/927] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:51 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:51.919768 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-f0e8e3e2-d2d7-423e-bdfb-3415f1ee439b req-0271b77e-40eb-4868-a12a-cb42028e7a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c38b798-2640-427f-915e-9a40f83e3b6e", "name": "network-vif-plugged", "status": "completed", "tag": "2e14e194-347c-4bad-a3ce-d09d56be7ce1"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:51.921543 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:10:51.921543 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:10:51.935665 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-f0e8e3e2-d2d7-423e-bdfb-3415f1ee439b req-0271b77e-40eb-4868-a12a-cb42028e7a0e service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:51.936434 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-f0e8e3e2-d2d7-423e-bdfb-3415f1ee439b req-0271b77e-40eb-4868-a12a-cb42028e7a0e service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:51.955199 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-f0e8e3e2-d2d7-423e-bdfb-3415f1ee439b req-0271b77e-40eb-4868-a12a-cb42028e7a0e service nova] Creating event network-vif-plugged:2e14e194-347c-4bad-a3ce-d09d56be7ce1 for instance 5c38b798-2640-427f-915e-9a40f83e3b6e on hv-cinder-81803 Nov 24 03:10:51.961557 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-f0e8e3e2-d2d7-423e-bdfb-3415f1ee439b req-0271b77e-40eb-4868-a12a-cb42028e7a0e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046142 Nov 24 03:10:51.962379 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 475/928] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:10:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:10:52.298448 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d38d12d2-af08-452f-b22e-d48e95c823b4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:52.300135 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d38d12d2-af08-452f-b22e-d48e95c823b4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:52.311295 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d38d12d2-af08-452f-b22e-d48e95c823b4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:52.312108 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d38d12d2-af08-452f-b22e-d48e95c823b4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:52.313567 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d38d12d2-af08-452f-b22e-d48e95c823b4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:52.314370 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d38d12d2-af08-452f-b22e-d48e95c823b4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:52.350865 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d38d12d2-af08-452f-b22e-d48e95c823b4 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059747 Nov 24 03:10:52.351448 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 454/929] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Nov 24 03:10:52 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:10:52.466853 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2d709213-e963-4e53-80f3-7f3be901d0e8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:52.468017 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2d709213-e963-4e53-80f3-7f3be901d0e8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:52.475165 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2d709213-e963-4e53-80f3-7f3be901d0e8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:52.475623 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2d709213-e963-4e53-80f3-7f3be901d0e8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:52.476469 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2d709213-e963-4e53-80f3-7f3be901d0e8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:52.476910 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2d709213-e963-4e53-80f3-7f3be901d0e8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:52.509158 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2d709213-e963-4e53-80f3-7f3be901d0e8 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047419 Nov 24 03:10:52.509636 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 476/930] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Nov 24 03:10:52 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 03:10:52.570676 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-492251e8-7f8c-4045-8513-3f2c5eba5cac tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:52.571172 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-492251e8-7f8c-4045-8513-3f2c5eba5cac tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:52.577313 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-492251e8-7f8c-4045-8513-3f2c5eba5cac tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:52.577762 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-492251e8-7f8c-4045-8513-3f2c5eba5cac tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:52.578588 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-492251e8-7f8c-4045-8513-3f2c5eba5cac tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:52.579020 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-492251e8-7f8c-4045-8513-3f2c5eba5cac tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:52.606625 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-492251e8-7f8c-4045-8513-3f2c5eba5cac tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:10:52.698761 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-492251e8-7f8c-4045-8513-3f2c5eba5cac tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d" status: 204 len: 0 microversion: 2.1 time: 0.131412 Nov 24 03:10:52.699580 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 455/931] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:10:52 2021] DELETE /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:10:52.711348 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ee4c337f-084d-4e93-894d-5425349a2d22 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:52.712100 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ee4c337f-084d-4e93-894d-5425349a2d22 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:52.719784 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ee4c337f-084d-4e93-894d-5425349a2d22 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:52.720411 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ee4c337f-084d-4e93-894d-5425349a2d22 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:52.721464 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ee4c337f-084d-4e93-894d-5425349a2d22 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:52.721948 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ee4c337f-084d-4e93-894d-5425349a2d22 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:52.743306 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-98b912b2-1e24-4c81-8dcd-d21512a6c3e1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:52.744017 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-98b912b2-1e24-4c81-8dcd-d21512a6c3e1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:52.753351 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-98b912b2-1e24-4c81-8dcd-d21512a6c3e1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:52.760042 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-98b912b2-1e24-4c81-8dcd-d21512a6c3e1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:52.761021 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-98b912b2-1e24-4c81-8dcd-d21512a6c3e1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:52.761513 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-98b912b2-1e24-4c81-8dcd-d21512a6c3e1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:52.879904 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ee4c337f-084d-4e93-894d-5425349a2d22 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:52.888415 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ee4c337f-084d-4e93-894d-5425349a2d22 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d" status: 200 len: 1673 microversion: 2.1 time: 0.184074 Nov 24 03:10:52.889015 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 477/932] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:52 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d => generated 1673 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:52.926719 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-98b912b2-1e24-4c81-8dcd-d21512a6c3e1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:52.935339 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-98b912b2-1e24-4c81-8dcd-d21512a6c3e1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:52.936859 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-98b912b2-1e24-4c81-8dcd-d21512a6c3e1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:52.938051 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-98b912b2-1e24-4c81-8dcd-d21512a6c3e1 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1729 microversion: 2.20 time: 0.198974 Nov 24 03:10:52.938648 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 456/933] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:52 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 03:10:53.905483 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-72dab680-e652-4ff3-b7b4-5571bfa6458c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:53.906702 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-72dab680-e652-4ff3-b7b4-5571bfa6458c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:53.913199 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-72dab680-e652-4ff3-b7b4-5571bfa6458c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:53.913626 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-72dab680-e652-4ff3-b7b4-5571bfa6458c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:53.914500 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-72dab680-e652-4ff3-b7b4-5571bfa6458c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:53.914918 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-72dab680-e652-4ff3-b7b4-5571bfa6458c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:53.960935 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4e8fc102-71af-4301-8b8a-cd9dd9f0560d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:53.962118 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4e8fc102-71af-4301-8b8a-cd9dd9f0560d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:53.971658 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e8fc102-71af-4301-8b8a-cd9dd9f0560d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:53.972448 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e8fc102-71af-4301-8b8a-cd9dd9f0560d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:53.973269 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e8fc102-71af-4301-8b8a-cd9dd9f0560d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:53.973712 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e8fc102-71af-4301-8b8a-cd9dd9f0560d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:54.079980 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-72dab680-e652-4ff3-b7b4-5571bfa6458c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:54.088335 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-72dab680-e652-4ff3-b7b4-5571bfa6458c tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d" status: 200 len: 1673 microversion: 2.1 time: 0.186527 Nov 24 03:10:54.088921 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 478/934] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:53 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d => generated 1673 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:54.144814 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4e8fc102-71af-4301-8b8a-cd9dd9f0560d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:54.153590 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4e8fc102-71af-4301-8b8a-cd9dd9f0560d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:54.155122 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4e8fc102-71af-4301-8b8a-cd9dd9f0560d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:54.156283 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4e8fc102-71af-4301-8b8a-cd9dd9f0560d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1729 microversion: 2.20 time: 0.202867 Nov 24 03:10:54.156856 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 457/935] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:53 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:55.107376 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ed9b7dde-de68-4e1a-ac6a-b1c5c404fcba tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:55.108115 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ed9b7dde-de68-4e1a-ac6a-b1c5c404fcba tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:55.115695 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ed9b7dde-de68-4e1a-ac6a-b1c5c404fcba tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:55.116106 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ed9b7dde-de68-4e1a-ac6a-b1c5c404fcba tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:55.117149 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ed9b7dde-de68-4e1a-ac6a-b1c5c404fcba tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:55.117585 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ed9b7dde-de68-4e1a-ac6a-b1c5c404fcba tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:55.177299 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2d21cbe0-73f1-48c8-90cf-91595dd9d8e9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:55.178060 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2d21cbe0-73f1-48c8-90cf-91595dd9d8e9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:55.184937 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d21cbe0-73f1-48c8-90cf-91595dd9d8e9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:55.185577 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d21cbe0-73f1-48c8-90cf-91595dd9d8e9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:55.186409 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d21cbe0-73f1-48c8-90cf-91595dd9d8e9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:55.186838 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d21cbe0-73f1-48c8-90cf-91595dd9d8e9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:55.278381 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ed9b7dde-de68-4e1a-ac6a-b1c5c404fcba tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bd0f1d66884b66945eec4ede0aea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1368b90b7cae4e3d936fcd3a97893dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:55.287584 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ed9b7dde-de68-4e1a-ac6a-b1c5c404fcba tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d" status: 200 len: 1673 microversion: 2.1 time: 0.183834 Nov 24 03:10:55.288161 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 479/936] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:55 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:10:55.408321 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2d21cbe0-73f1-48c8-90cf-91595dd9d8e9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:55.419455 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2d21cbe0-73f1-48c8-90cf-91595dd9d8e9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:55.421007 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2d21cbe0-73f1-48c8-90cf-91595dd9d8e9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:10:55.422324 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2d21cbe0-73f1-48c8-90cf-91595dd9d8e9 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1716 microversion: 2.20 time: 0.250796 Nov 24 03:10:55.422902 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 458/937] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:10:55 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1716 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:10:55.762849 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-05249821-b949-4681-bc77-d0482968a341 req-f832ff3c-3993-4b3a-87e2-689bcf707d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d", "name": "network-vif-deleted", "tag": "e4a550de-aba7-444f-a02c-0c033cb2032d"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:10:55.764653 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:10:55.764653 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:10:55.774029 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-05249821-b949-4681-bc77-d0482968a341 req-f832ff3c-3993-4b3a-87e2-689bcf707d1d service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:55.775276 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-05249821-b949-4681-bc77-d0482968a341 req-f832ff3c-3993-4b3a-87e2-689bcf707d1d service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:55.788972 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-05249821-b949-4681-bc77-d0482968a341 req-f832ff3c-3993-4b3a-87e2-689bcf707d1d service nova] Creating event network-vif-deleted:e4a550de-aba7-444f-a02c-0c033cb2032d for instance e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d on hv-cinder-81803 Nov 24 03:10:55.794785 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-05249821-b949-4681-bc77-d0482968a341 req-f832ff3c-3993-4b3a-87e2-689bcf707d1d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037643 Nov 24 03:10:55.796130 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 480/938] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:10:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:10:56.309131 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-10680f47-57d1-4786-9f75-3728ca327dd3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:56.309762 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-10680f47-57d1-4786-9f75-3728ca327dd3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:56.317138 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-10680f47-57d1-4786-9f75-3728ca327dd3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:56.317595 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-10680f47-57d1-4786-9f75-3728ca327dd3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:56.318435 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-10680f47-57d1-4786-9f75-3728ca327dd3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:56.318876 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-10680f47-57d1-4786-9f75-3728ca327dd3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:56.338268 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-10680f47-57d1-4786-9f75-3728ca327dd3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] HTTP exception thrown: Instance e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d could not be found. Nov 24 03:10:56.339717 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-10680f47-57d1-4786-9f75-3728ca327dd3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Returning 404 to user: Instance e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:10:56.340898 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-10680f47-57d1-4786-9f75-3728ca327dd3 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d" status: 404 len: 111 microversion: 2.1 time: 0.035984 Nov 24 03:10:56.341555 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 459/939] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:56 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:10:56.350828 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-47f81638-9c2c-4740-a12c-0b61cb6cbb30 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '.version_select at 0x7f7a2dde71f0>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:56.369879 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-47f81638-9c2c-4740-a12c-0b61cb6cbb30 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1979423901" status: 202 len: 0 microversion: 2.1 time: 0.023008 Nov 24 03:10:56.370502 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 481/940] 10.222.0.52 () {58 vars in 1220 bytes} [Wed Nov 24 03:10:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1979423901 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:10:59.698225 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2fce369d-1b4d-436b-9474-6f7e49410f8b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:59.698922 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2fce369d-1b4d-436b-9474-6f7e49410f8b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:59.706287 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2fce369d-1b4d-436b-9474-6f7e49410f8b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:59.706900 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2fce369d-1b4d-436b-9474-6f7e49410f8b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:59.707525 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2fce369d-1b4d-436b-9474-6f7e49410f8b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:59.707959 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2fce369d-1b4d-436b-9474-6f7e49410f8b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:59.725224 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-2fce369d-1b4d-436b-9474-6f7e49410f8b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] HTTP exception thrown: Instance e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d could not be found. Nov 24 03:10:59.725956 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2fce369d-1b4d-436b-9474-6f7e49410f8b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Returning 404 to user: Instance e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:10:59.726864 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2fce369d-1b4d-436b-9474-6f7e49410f8b tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d" status: 404 len: 111 microversion: 2.1 time: 0.032888 Nov 24 03:10:59.727671 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 460/941] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:10:59 2021] DELETE /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:10:59.737276 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e2c0777d-c6c4-4e73-8cce-96f595fcd727 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:10:59.737946 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e2c0777d-c6c4-4e73-8cce-96f595fcd727 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:10:59.745594 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e2c0777d-c6c4-4e73-8cce-96f595fcd727 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:59.746232 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e2c0777d-c6c4-4e73-8cce-96f595fcd727 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:59.746820 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e2c0777d-c6c4-4e73-8cce-96f595fcd727 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:10:59.747253 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e2c0777d-c6c4-4e73-8cce-96f595fcd727 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:10:59.761256 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-e2c0777d-c6c4-4e73-8cce-96f595fcd727 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] HTTP exception thrown: Instance e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d could not be found. Nov 24 03:10:59.761866 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e2c0777d-c6c4-4e73-8cce-96f595fcd727 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Returning 404 to user: Instance e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:10:59.762740 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e2c0777d-c6c4-4e73-8cce-96f595fcd727 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d" status: 404 len: 111 microversion: 2.1 time: 0.029532 Nov 24 03:10:59.763308 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 482/942] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:10:59 2021] GET /compute/v2.1/servers/e1e5d2e2-3bb9-42c4-bdac-51b9adabbe7d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:11:00.912835 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-76f00ede-2e81-41d7-9313-a2aabf7feaa5 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:00.913385 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-76f00ede-2e81-41d7-9313-a2aabf7feaa5 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:00.920096 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76f00ede-2e81-41d7-9313-a2aabf7feaa5 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:00.920558 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76f00ede-2e81-41d7-9313-a2aabf7feaa5 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:00.921353 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76f00ede-2e81-41d7-9313-a2aabf7feaa5 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:00.921786 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76f00ede-2e81-41d7-9313-a2aabf7feaa5 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:00.936454 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-76f00ede-2e81-41d7-9313-a2aabf7feaa5 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] HTTP exception thrown: Instance dd9b822e-b442-450a-acaa-df8261422f50 could not be found. Nov 24 03:11:00.937050 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-76f00ede-2e81-41d7-9313-a2aabf7feaa5 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Returning 404 to user: Instance dd9b822e-b442-450a-acaa-df8261422f50 could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:11:00.937900 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-76f00ede-2e81-41d7-9313-a2aabf7feaa5 tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 404 len: 111 microversion: 2.1 time: 0.029025 Nov 24 03:11:00.938540 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 461/943] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:11:00 2021] DELETE /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:11:00.947404 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0b466f50-39ac-4ba7-a164-e161c57dea5a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:00.948114 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0b466f50-39ac-4ba7-a164-e161c57dea5a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] [instance: dd9b822e-b442-450a-acaa-df8261422f50] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:00.955016 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0b466f50-39ac-4ba7-a164-e161c57dea5a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:00.955478 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0b466f50-39ac-4ba7-a164-e161c57dea5a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:00.956283 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0b466f50-39ac-4ba7-a164-e161c57dea5a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:00.956712 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0b466f50-39ac-4ba7-a164-e161c57dea5a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:00.972078 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-0b466f50-39ac-4ba7-a164-e161c57dea5a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] HTTP exception thrown: Instance dd9b822e-b442-450a-acaa-df8261422f50 could not be found. Nov 24 03:11:00.972677 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0b466f50-39ac-4ba7-a164-e161c57dea5a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] Returning 404 to user: Instance dd9b822e-b442-450a-acaa-df8261422f50 could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:11:00.973524 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0b466f50-39ac-4ba7-a164-e161c57dea5a tempest-AttachVolumeTestJSON-2014162539 tempest-AttachVolumeTestJSON-2014162539-project] 10.222.0.52 "GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50" status: 404 len: 111 microversion: 2.1 time: 0.029939 Nov 24 03:11:00.974148 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 483/944] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:00 2021] GET /compute/v2.1/servers/dd9b822e-b442-450a-acaa-df8261422f50 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:11:06.207548 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 03:11:06.208174 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: Wed Nov 24 03:11:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 03:11:28.813823 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3d48f98e-5d20-44ad-acba-14d1f4039b8d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:28.814812 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3d48f98e-5d20-44ad-acba-14d1f4039b8d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:28.820807 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3d48f98e-5d20-44ad-acba-14d1f4039b8d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:28.821250 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3d48f98e-5d20-44ad-acba-14d1f4039b8d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:28.822066 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3d48f98e-5d20-44ad-acba-14d1f4039b8d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:28.822513 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3d48f98e-5d20-44ad-acba-14d1f4039b8d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:28.854112 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3d48f98e-5d20-44ad-acba-14d1f4039b8d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044177 Nov 24 03:11:28.854683 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 462/945] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Nov 24 03:11:28 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:11:28.913733 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-e5caee46-50bb-43ee-959e-b88277c38c39 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:28.914362 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e5caee46-50bb-43ee-959e-b88277c38c39 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:28.924039 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e5caee46-50bb-43ee-959e-b88277c38c39 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:28.924476 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e5caee46-50bb-43ee-959e-b88277c38c39 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:28.925266 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e5caee46-50bb-43ee-959e-b88277c38c39 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:28.925692 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-e5caee46-50bb-43ee-959e-b88277c38c39 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:28.952751 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-e5caee46-50bb-43ee-959e-b88277c38c39 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Going to try to terminate instance {{(pid=116331) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:11:29.044933 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-e5caee46-50bb-43ee-959e-b88277c38c39 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 204 len: 0 microversion: 2.20 time: 0.134744 Nov 24 03:11:29.045709 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 484/946] 10.222.0.52 () {60 vars in 1279 bytes} [Wed Nov 24 03:11:28 2021] DELETE /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 24 03:11:29.056071 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-15182da8-37b1-4bbf-b4ff-2657aa9ec19c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:29.056795 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-15182da8-37b1-4bbf-b4ff-2657aa9ec19c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:29.064270 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15182da8-37b1-4bbf-b4ff-2657aa9ec19c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:29.064808 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15182da8-37b1-4bbf-b4ff-2657aa9ec19c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:29.065650 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15182da8-37b1-4bbf-b4ff-2657aa9ec19c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:29.066200 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15182da8-37b1-4bbf-b4ff-2657aa9ec19c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:29.211049 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-15182da8-37b1-4bbf-b4ff-2657aa9ec19c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:29.221670 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-15182da8-37b1-4bbf-b4ff-2657aa9ec19c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:29.223239 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-15182da8-37b1-4bbf-b4ff-2657aa9ec19c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:29.224470 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-15182da8-37b1-4bbf-b4ff-2657aa9ec19c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.172251 Nov 24 03:11:29.225044 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 463/947] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:11:29 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:11:30.257176 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0d846a19-ba9e-44f5-815b-d55cab3c72c2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:30.259502 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0d846a19-ba9e-44f5-815b-d55cab3c72c2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:30.270444 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0d846a19-ba9e-44f5-815b-d55cab3c72c2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:30.271135 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0d846a19-ba9e-44f5-815b-d55cab3c72c2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:30.272498 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0d846a19-ba9e-44f5-815b-d55cab3c72c2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:30.273263 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0d846a19-ba9e-44f5-815b-d55cab3c72c2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:30.449168 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0d846a19-ba9e-44f5-815b-d55cab3c72c2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:30.457402 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0d846a19-ba9e-44f5-815b-d55cab3c72c2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:30.458922 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0d846a19-ba9e-44f5-815b-d55cab3c72c2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:30.460087 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0d846a19-ba9e-44f5-815b-d55cab3c72c2 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1722 microversion: 2.20 time: 0.213454 Nov 24 03:11:30.460656 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 485/948] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:11:30 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:11:31.435210 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-37aa1b4b-6e00-445d-a986-1647350d45ed req-2ac13048-6c21-4b6d-a633-7362e653a4d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c38b798-2640-427f-915e-9a40f83e3b6e", "name": "network-vif-deleted", "tag": "2e14e194-347c-4bad-a3ce-d09d56be7ce1"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:11:31.436887 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:11:31.436887 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:11:31.447906 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-37aa1b4b-6e00-445d-a986-1647350d45ed req-2ac13048-6c21-4b6d-a633-7362e653a4d3 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:31.448356 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-37aa1b4b-6e00-445d-a986-1647350d45ed req-2ac13048-6c21-4b6d-a633-7362e653a4d3 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:31.461581 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-37aa1b4b-6e00-445d-a986-1647350d45ed req-2ac13048-6c21-4b6d-a633-7362e653a4d3 service nova] Creating event network-vif-deleted:2e14e194-347c-4bad-a3ce-d09d56be7ce1 for instance 5c38b798-2640-427f-915e-9a40f83e3b6e on hv-cinder-81803 Nov 24 03:11:31.466983 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-37aa1b4b-6e00-445d-a986-1647350d45ed req-2ac13048-6c21-4b6d-a633-7362e653a4d3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035946 Nov 24 03:11:31.471628 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 464/949] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:11:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:11:31.480653 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-1d124904-540f-4f0e-b30b-fea5fc79288a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:31.482085 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-1d124904-540f-4f0e-b30b-fea5fc79288a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:31.494063 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1d124904-540f-4f0e-b30b-fea5fc79288a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:31.494511 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1d124904-540f-4f0e-b30b-fea5fc79288a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:31.495321 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1d124904-540f-4f0e-b30b-fea5fc79288a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:31.496370 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1d124904-540f-4f0e-b30b-fea5fc79288a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:31.576556 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-1d124904-540f-4f0e-b30b-fea5fc79288a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:31.590718 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-1d124904-540f-4f0e-b30b-fea5fc79288a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:31.597613 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-1d124904-540f-4f0e-b30b-fea5fc79288a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:31.600403 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-1d124904-540f-4f0e-b30b-fea5fc79288a tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1365 microversion: 2.20 time: 0.124603 Nov 24 03:11:31.606073 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 486/950] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:11:31 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1365 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:11:32.619440 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-40e88034-1f71-4e45-8e0a-ee62b35612af tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:32.620129 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-40e88034-1f71-4e45-8e0a-ee62b35612af tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:32.627619 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-40e88034-1f71-4e45-8e0a-ee62b35612af tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:32.628068 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-40e88034-1f71-4e45-8e0a-ee62b35612af tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:32.628886 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-40e88034-1f71-4e45-8e0a-ee62b35612af tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:32.629327 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-40e88034-1f71-4e45-8e0a-ee62b35612af tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:32.675403 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-40e88034-1f71-4e45-8e0a-ee62b35612af tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:32.675851 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-40e88034-1f71-4e45-8e0a-ee62b35612af tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:32.676296 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-40e88034-1f71-4e45-8e0a-ee62b35612af tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lazy-loading 'fault' on Instance uuid 5c38b798-2640-427f-915e-9a40f83e3b6e {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:11:32.722694 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-40e88034-1f71-4e45-8e0a-ee62b35612af tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:32.730963 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-40e88034-1f71-4e45-8e0a-ee62b35612af tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:32.732440 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-40e88034-1f71-4e45-8e0a-ee62b35612af tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:32.736067 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-40e88034-1f71-4e45-8e0a-ee62b35612af tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1370 microversion: 2.20 time: 0.118333 Nov 24 03:11:32.736067 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 465/951] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:11:32 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1370 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:11:33.753901 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-78a2b9ad-964c-4e26-8311-f303db818aa8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:33.754498 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-78a2b9ad-964c-4e26-8311-f303db818aa8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:33.760384 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-78a2b9ad-964c-4e26-8311-f303db818aa8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:33.760827 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-78a2b9ad-964c-4e26-8311-f303db818aa8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:33.761591 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-78a2b9ad-964c-4e26-8311-f303db818aa8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:33.762050 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-78a2b9ad-964c-4e26-8311-f303db818aa8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:33.793339 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-78a2b9ad-964c-4e26-8311-f303db818aa8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:33.793745 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-78a2b9ad-964c-4e26-8311-f303db818aa8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:33.797190 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.objects.instance [None req-78a2b9ad-964c-4e26-8311-f303db818aa8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lazy-loading 'fault' on Instance uuid 5c38b798-2640-427f-915e-9a40f83e3b6e {{(pid=116331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:11:33.837894 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-78a2b9ad-964c-4e26-8311-f303db818aa8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:33.847792 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-78a2b9ad-964c-4e26-8311-f303db818aa8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:33.849292 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-78a2b9ad-964c-4e26-8311-f303db818aa8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bbe87944f9c4cd292ec856f6ce7ccd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1fc30b25794d87bec45177a9dcfb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:33.850502 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-78a2b9ad-964c-4e26-8311-f303db818aa8 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 200 len: 1370 microversion: 2.20 time: 0.101680 Nov 24 03:11:33.851079 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 487/952] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:11:33 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 1370 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 03:11:34.870777 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-cb4eddc1-9a00-4bd9-b767-e03a2a89b13d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:34.871859 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-cb4eddc1-9a00-4bd9-b767-e03a2a89b13d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:34.879444 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cb4eddc1-9a00-4bd9-b767-e03a2a89b13d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:34.879870 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cb4eddc1-9a00-4bd9-b767-e03a2a89b13d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:34.880690 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cb4eddc1-9a00-4bd9-b767-e03a2a89b13d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:34.881128 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cb4eddc1-9a00-4bd9-b767-e03a2a89b13d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:34.897157 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-cb4eddc1-9a00-4bd9-b767-e03a2a89b13d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] HTTP exception thrown: Instance 5c38b798-2640-427f-915e-9a40f83e3b6e could not be found. Nov 24 03:11:34.897757 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-cb4eddc1-9a00-4bd9-b767-e03a2a89b13d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Returning 404 to user: Instance 5c38b798-2640-427f-915e-9a40f83e3b6e could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:11:34.898650 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-cb4eddc1-9a00-4bd9-b767-e03a2a89b13d tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 404 len: 111 microversion: 2.20 time: 0.033470 Nov 24 03:11:34.899215 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 466/953] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Nov 24 03:11:34 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 24 03:11:34.909111 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-d6e5188d-960b-4d73-8fe2-7003f12a217c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '.version_select at 0x7f7a2dccc430>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:34.947459 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-d6e5188d-960b-4d73-8fe2-7003f12a217c tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-295997511" status: 204 len: 0 microversion: 2.20 time: 0.042610 Nov 24 03:11:34.948474 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 488/954] 10.222.0.52 () {60 vars in 1258 bytes} [Wed Nov 24 03:11:34 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-295997511 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 24 03:11:36.799076 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-71c112ae-376d-4cc0-a014-986668863226 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:36.799862 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-71c112ae-376d-4cc0-a014-986668863226 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:36.806745 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-71c112ae-376d-4cc0-a014-986668863226 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:36.807333 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-71c112ae-376d-4cc0-a014-986668863226 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:36.808522 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-71c112ae-376d-4cc0-a014-986668863226 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:36.809172 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-71c112ae-376d-4cc0-a014-986668863226 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:36.832002 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-71c112ae-376d-4cc0-a014-986668863226 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] HTTP exception thrown: Instance 5c38b798-2640-427f-915e-9a40f83e3b6e could not be found. Nov 24 03:11:36.833034 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-71c112ae-376d-4cc0-a014-986668863226 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Returning 404 to user: Instance 5c38b798-2640-427f-915e-9a40f83e3b6e could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:11:36.834291 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-71c112ae-376d-4cc0-a014-986668863226 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 404 len: 111 microversion: 2.1 time: 0.038844 Nov 24 03:11:36.835076 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 467/955] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:11:36 2021] DELETE /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 03:11:36.847102 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-6af832c8-a6cb-4342-824b-d3ac58ac6648 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:36.848193 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-6af832c8-a6cb-4342-824b-d3ac58ac6648 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: 5c38b798-2640-427f-915e-9a40f83e3b6e] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:36.860440 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6af832c8-a6cb-4342-824b-d3ac58ac6648 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:36.861259 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6af832c8-a6cb-4342-824b-d3ac58ac6648 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:36.862778 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6af832c8-a6cb-4342-824b-d3ac58ac6648 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:36.863599 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-6af832c8-a6cb-4342-824b-d3ac58ac6648 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:36.895291 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-6af832c8-a6cb-4342-824b-d3ac58ac6648 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] HTTP exception thrown: Instance 5c38b798-2640-427f-915e-9a40f83e3b6e could not be found. Nov 24 03:11:36.896374 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-6af832c8-a6cb-4342-824b-d3ac58ac6648 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Returning 404 to user: Instance 5c38b798-2640-427f-915e-9a40f83e3b6e could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:11:36.898266 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-6af832c8-a6cb-4342-824b-d3ac58ac6648 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e" status: 404 len: 111 microversion: 2.1 time: 0.057133 Nov 24 03:11:36.899322 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 489/956] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:36 2021] GET /compute/v2.1/servers/5c38b798-2640-427f-915e-9a40f83e3b6e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:11:38.049391 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2740b2e7-537e-4ebe-8579-40403644b854 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:38.050045 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2740b2e7-537e-4ebe-8579-40403644b854 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:38.057548 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2740b2e7-537e-4ebe-8579-40403644b854 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:38.057992 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2740b2e7-537e-4ebe-8579-40403644b854 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:38.059464 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2740b2e7-537e-4ebe-8579-40403644b854 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:38.059464 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2740b2e7-537e-4ebe-8579-40403644b854 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:38.075676 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-2740b2e7-537e-4ebe-8579-40403644b854 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] HTTP exception thrown: Instance dfaf6d4e-4188-451d-8af8-32300d13ae2d could not be found. Nov 24 03:11:38.076314 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2740b2e7-537e-4ebe-8579-40403644b854 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Returning 404 to user: Instance dfaf6d4e-4188-451d-8af8-32300d13ae2d could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:11:38.077168 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2740b2e7-537e-4ebe-8579-40403644b854 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 404 len: 111 microversion: 2.1 time: 0.034724 Nov 24 03:11:38.077946 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 468/957] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:11:38 2021] DELETE /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:11:38.089028 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f1b0e7de-4dac-4c6c-a53b-a631adbc9036 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:38.090104 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f1b0e7de-4dac-4c6c-a53b-a631adbc9036 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] [instance: dfaf6d4e-4188-451d-8af8-32300d13ae2d] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:38.099772 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f1b0e7de-4dac-4c6c-a53b-a631adbc9036 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:38.100432 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f1b0e7de-4dac-4c6c-a53b-a631adbc9036 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:38.101576 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f1b0e7de-4dac-4c6c-a53b-a631adbc9036 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:38.102233 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f1b0e7de-4dac-4c6c-a53b-a631adbc9036 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:38.122612 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-f1b0e7de-4dac-4c6c-a53b-a631adbc9036 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] HTTP exception thrown: Instance dfaf6d4e-4188-451d-8af8-32300d13ae2d could not be found. Nov 24 03:11:38.123436 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f1b0e7de-4dac-4c6c-a53b-a631adbc9036 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] Returning 404 to user: Instance dfaf6d4e-4188-451d-8af8-32300d13ae2d could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:11:38.124607 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f1b0e7de-4dac-4c6c-a53b-a631adbc9036 tempest-AttachVolumeShelveTestJSON-1682005626 tempest-AttachVolumeShelveTestJSON-1682005626-project] 10.222.0.52 "GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d" status: 404 len: 111 microversion: 2.1 time: 0.041652 Nov 24 03:11:38.125383 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 490/958] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:38 2021] GET /compute/v2.1/servers/dfaf6d4e-4188-451d-8af8-32300d13ae2d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:11:43.673620 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b3898cf6-3c94-4b37-8802-a1fae7f7e17b tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Action: 'create', calling method: .version_select at 0x7f7a2dddb310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-745736154"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:11:43.813313 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-a67c4fd2-d362-454d-81a5-284483e4a638 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:43.814198 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-a67c4fd2-d362-454d-81a5-284483e4a638 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:43.832659 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a67c4fd2-d362-454d-81a5-284483e4a638 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:43.833079 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a67c4fd2-d362-454d-81a5-284483e4a638 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:43.834166 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a67c4fd2-d362-454d-81a5-284483e4a638 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:43.834590 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a67c4fd2-d362-454d-81a5-284483e4a638 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:43.864624 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-a67c4fd2-d362-454d-81a5-284483e4a638 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Going to try to terminate instance {{(pid=116331) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:11:43.987483 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-a67c4fd2-d362-454d-81a5-284483e4a638 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "DELETE /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 204 len: 0 microversion: 2.1 time: 0.176796 Nov 24 03:11:43.989414 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 491/959] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:11:43 2021] DELETE /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 03:11:44.007546 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-6a9604d8-810f-4826-b3d5-b0eda4ba1481 req-7c0ad050-205f-42c3-b4ed-608a85b22178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262867ad-b362-4696-9425-81751e68d74f", "tag": "74c8f067-ea92-4a51-9064-326e74424693"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:11:44.009473 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:11:44.009473 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:11:44.018156 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-6a9604d8-810f-4826-b3d5-b0eda4ba1481 req-7c0ad050-205f-42c3-b4ed-608a85b22178 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:44.018606 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-6a9604d8-810f-4826-b3d5-b0eda4ba1481 req-7c0ad050-205f-42c3-b4ed-608a85b22178 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:44.031297 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-6a9604d8-810f-4826-b3d5-b0eda4ba1481 req-7c0ad050-205f-42c3-b4ed-608a85b22178 service nova] Creating event network-changed:74c8f067-ea92-4a51-9064-326e74424693 for instance 262867ad-b362-4696-9425-81751e68d74f on hv-cinder-81803 Nov 24 03:11:44.036790 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-6a9604d8-810f-4826-b3d5-b0eda4ba1481 req-7c0ad050-205f-42c3-b4ed-608a85b22178 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045088 Nov 24 03:11:44.038163 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 492/960] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:11:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:11:44.045710 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-aff9998d-a634-444a-81cc-955d07edf126 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:44.046742 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-aff9998d-a634-444a-81cc-955d07edf126 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:44.053934 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-aff9998d-a634-444a-81cc-955d07edf126 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:44.054872 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-aff9998d-a634-444a-81cc-955d07edf126 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:44.055870 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-aff9998d-a634-444a-81cc-955d07edf126 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:44.056477 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-aff9998d-a634-444a-81cc-955d07edf126 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:44.131502 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b3898cf6-3c94-4b37-8802-a1fae7f7e17b tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.615649 Nov 24 03:11:44.138508 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 469/961] 10.222.0.52 () {60 vars in 1154 bytes} [Wed Nov 24 03:11:43 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 619 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 24 03:11:44.147202 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4554b5b3-9255-4c7c-b2df-9f3fc9d91e85 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Calling method '.version_select at 0x7f7a2ddeb430>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:44.285571 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4554b5b3-9255-4c7c-b2df-9f3fc9d91e85 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/da55637e-5b1e-425a-aad9-0bc23a798757" status: 200 len: 344 microversion: 2.1 time: 0.144947 Nov 24 03:11:44.286520 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 470/962] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Nov 24 03:11:44 2021] GET /compute/v2.1/os-volumes/da55637e-5b1e-425a-aad9-0bc23a798757 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:11:44.340744 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-aff9998d-a634-444a-81cc-955d07edf126 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:44.361249 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-aff9998d-a634-444a-81cc-955d07edf126 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1571 microversion: 2.1 time: 0.320865 Nov 24 03:11:44.362655 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 493/963] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:44 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1571 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:11:45.154666 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9037d92d-f397-4160-b4f5-1db431db7e10 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1986216153", "imageRef": "04860a4a-47c3-4532-865d-be6c9c493af7", "flavorRef": "452", "networks": [{"uuid": "4084daa0-1103-4a60-b744-f9d306495aa3"}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:11:45.216578 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-9037d92d-f397-4160-b4f5-1db431db7e10 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] validate_networks() for [('4084daa0-1103-4a60-b744-f9d306495aa3', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:11:45.301382 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-71bc6815-7472-43f7-a698-50de2bf8440e tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Calling method '.version_select at 0x7f7a2dd5da60>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:45.358748 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-71bc6815-7472-43f7-a698-50de2bf8440e tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/da55637e-5b1e-425a-aad9-0bc23a798757" status: 200 len: 345 microversion: 2.1 time: 0.061490 Nov 24 03:11:45.359343 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 494/964] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Nov 24 03:11:45 2021] GET /compute/v2.1/os-volumes/da55637e-5b1e-425a-aad9-0bc23a798757 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:11:45.371053 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-200692ab-573f-4d3b-9fd6-1782dfdaece4 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Action: 'create', calling method: .version_select at 0x7f7a2dd17160>, body: {"snapshot": {"volume_id": "da55637e-5b1e-425a-aad9-0bc23a798757", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1905769888"}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:11:45.543587 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-200692ab-573f-4d3b-9fd6-1782dfdaece4 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.176334 Nov 24 03:11:45.544173 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 495/965] 10.222.0.52 () {60 vars in 1161 bytes} [Wed Nov 24 03:11:45 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:11:45.549647 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-72ea08e9-e51a-4c9d-b5b9-ef77fabc1430 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:45.550389 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-72ea08e9-e51a-4c9d-b5b9-ef77fabc1430 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:45.558335 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-72ea08e9-e51a-4c9d-b5b9-ef77fabc1430 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:45.558966 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-72ea08e9-e51a-4c9d-b5b9-ef77fabc1430 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:45.559994 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-72ea08e9-e51a-4c9d-b5b9-ef77fabc1430 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:45.560435 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-72ea08e9-e51a-4c9d-b5b9-ef77fabc1430 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:45.759944 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-72ea08e9-e51a-4c9d-b5b9-ef77fabc1430 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:45.772281 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-72ea08e9-e51a-4c9d-b5b9-ef77fabc1430 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1452 microversion: 2.1 time: 0.226819 Nov 24 03:11:45.773384 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 496/966] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:45 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1452 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:11:45.778567 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-8be4f671-a55b-4c94-aa15-6416e5aff303 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Calling method '.version_select at 0x7f7a2ea540d0>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:45.823085 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-9037d92d-f397-4160-b4f5-1db431db7e10 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:11:45.823854 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-9037d92d-f397-4160-b4f5-1db431db7e10 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:11:45.824624 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-9037d92d-f397-4160-b4f5-1db431db7e10 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:11:45.825467 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-9037d92d-f397-4160-b4f5-1db431db7e10 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:11:45.826015 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-9037d92d-f397-4160-b4f5-1db431db7e10 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:11:45.837949 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9037d92d-f397-4160-b4f5-1db431db7e10 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:45.838471 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9037d92d-f397-4160-b4f5-1db431db7e10 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:45.839550 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9037d92d-f397-4160-b4f5-1db431db7e10 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:45.840213 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9037d92d-f397-4160-b4f5-1db431db7e10 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:45.841320 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-8be4f671-a55b-4c94-aa15-6416e5aff303 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7a2409cb-5932-4b9b-ab77-f8bd40a36206" status: 200 len: 287 microversion: 2.1 time: 0.066145 Nov 24 03:11:45.842618 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 497/967] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Nov 24 03:11:45 2021] GET /compute/v2.1/os-snapshots/7a2409cb-5932-4b9b-ab77-f8bd40a36206 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:11:45.857181 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-946f79f6-5b9f-4813-8c04-8c21c6d1eed3 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Calling method '.version_select at 0x7f7a2dd810d0>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:45.861292 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-9037d92d-f397-4160-b4f5-1db431db7e10 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Getting quotas for project de048ca1330d41aa8231217a13fe5327. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:11:45.865655 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-9037d92d-f397-4160-b4f5-1db431db7e10 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Getting quotas for user 01892d0dcfcd41d0bd1fc73c50f68698 and project de048ca1330d41aa8231217a13fe5327. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:11:45.878483 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9037d92d-f397-4160-b4f5-1db431db7e10 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:11:45.881142 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9037d92d-f397-4160-b4f5-1db431db7e10 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04860a4a-47c3-4532-865d-be6c9c493af7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:11:45.902511 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-946f79f6-5b9f-4813-8c04-8c21c6d1eed3 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.053148 Nov 24 03:11:45.904289 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 498/968] 10.222.0.52 () {58 vars in 1139 bytes} [Wed Nov 24 03:11:45 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:11:45.915366 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-dc3187b3-edf1-4b6c-99bc-704139346015 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Calling method '.version_select at 0x7f7a2ddd8670>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:45.945823 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9037d92d-f397-4160-b4f5-1db431db7e10 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797154 Nov 24 03:11:45.947296 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 471/969] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Nov 24 03:11:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 03:11:45.958598 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-dc3187b3-edf1-4b6c-99bc-704139346015 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7a2409cb-5932-4b9b-ab77-f8bd40a36206" status: 200 len: 287 microversion: 2.1 time: 0.047184 Nov 24 03:11:45.959884 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 499/970] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Nov 24 03:11:45 2021] GET /compute/v2.1/os-snapshots/7a2409cb-5932-4b9b-ab77-f8bd40a36206 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:11:45.966007 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f7304c64-ef8a-4fbb-a558-4d093d3d142b tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:45.966966 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f7304c64-ef8a-4fbb-a558-4d093d3d142b tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:46.055676 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f7304c64-ef8a-4fbb-a558-4d093d3d142b tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:46.069749 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f7304c64-ef8a-4fbb-a558-4d093d3d142b tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de" status: 200 len: 1219 microversion: 2.1 time: 0.112351 Nov 24 03:11:46.074053 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 472/971] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:45 2021] GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:11:46.337709 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-3064d216-8385-44cb-9e33-becb26d17139 req-788bb220-5568-4c8d-8168-19cae1729579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262867ad-b362-4696-9425-81751e68d74f", "name": "network-vif-deleted", "tag": "74c8f067-ea92-4a51-9064-326e74424693"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:11:46.339390 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:11:46.339390 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:11:46.347336 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-3064d216-8385-44cb-9e33-becb26d17139 req-788bb220-5568-4c8d-8168-19cae1729579 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:46.347797 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-3064d216-8385-44cb-9e33-becb26d17139 req-788bb220-5568-4c8d-8168-19cae1729579 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:46.360896 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-3064d216-8385-44cb-9e33-becb26d17139 req-788bb220-5568-4c8d-8168-19cae1729579 service nova] Creating event network-vif-deleted:74c8f067-ea92-4a51-9064-326e74424693 for instance 262867ad-b362-4696-9425-81751e68d74f on hv-cinder-81803 Nov 24 03:11:46.368725 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-3064d216-8385-44cb-9e33-becb26d17139 req-788bb220-5568-4c8d-8168-19cae1729579 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034642 Nov 24 03:11:46.369773 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 500/972] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:11:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:11:46.797363 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ae2e6c5b-e229-43a3-97df-eda048655779 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:46.797993 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ae2e6c5b-e229-43a3-97df-eda048655779 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:46.805039 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae2e6c5b-e229-43a3-97df-eda048655779 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:46.805488 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae2e6c5b-e229-43a3-97df-eda048655779 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:46.806383 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae2e6c5b-e229-43a3-97df-eda048655779 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:46.806864 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae2e6c5b-e229-43a3-97df-eda048655779 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:46.884200 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ae2e6c5b-e229-43a3-97df-eda048655779 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:46.900417 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ae2e6c5b-e229-43a3-97df-eda048655779 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1220 microversion: 2.1 time: 0.106470 Nov 24 03:11:46.901392 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 473/973] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:46 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1220 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:11:46.973932 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f36eaeb5-27cd-47b9-a12f-7bfdfe88ad81 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Calling method '.version_select at 0x7f7a2dcaeaf0>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:47.005441 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f36eaeb5-27cd-47b9-a12f-7bfdfe88ad81 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7a2409cb-5932-4b9b-ab77-f8bd40a36206" status: 200 len: 287 microversion: 2.1 time: 0.037182 Nov 24 03:11:47.006092 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 501/974] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Nov 24 03:11:46 2021] GET /compute/v2.1/os-snapshots/7a2409cb-5932-4b9b-ab77-f8bd40a36206 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:11:47.095825 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9adc5a60-9d6e-44ac-b00a-0c12a615e92d tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:47.096813 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9adc5a60-9d6e-44ac-b00a-0c12a615e92d tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:47.106675 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9adc5a60-9d6e-44ac-b00a-0c12a615e92d tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:47.107482 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9adc5a60-9d6e-44ac-b00a-0c12a615e92d tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:47.109304 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9adc5a60-9d6e-44ac-b00a-0c12a615e92d tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:47.113594 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9adc5a60-9d6e-44ac-b00a-0c12a615e92d tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:47.178856 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9adc5a60-9d6e-44ac-b00a-0c12a615e92d tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:47.187141 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9adc5a60-9d6e-44ac-b00a-0c12a615e92d tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de" status: 200 len: 1223 microversion: 2.1 time: 0.095071 Nov 24 03:11:47.187736 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 474/975] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:47 2021] GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:11:47.921667 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f9ffbbeb-d978-456b-9425-e0df15de1aa3 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:47.923198 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f9ffbbeb-d978-456b-9425-e0df15de1aa3 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:47.932136 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f9ffbbeb-d978-456b-9425-e0df15de1aa3 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:47.932589 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f9ffbbeb-d978-456b-9425-e0df15de1aa3 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:47.933383 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f9ffbbeb-d978-456b-9425-e0df15de1aa3 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:47.933811 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f9ffbbeb-d978-456b-9425-e0df15de1aa3 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:48.007361 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f9ffbbeb-d978-456b-9425-e0df15de1aa3 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:48.020794 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f9ffbbeb-d978-456b-9425-e0df15de1aa3 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1220 microversion: 2.1 time: 0.103507 Nov 24 03:11:48.021484 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 502/976] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:47 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:11:48.022360 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-10ecb417-32ab-4326-8a3e-c60215da745e tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Calling method '.version_select at 0x7f7a2dea0c10>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:48.063560 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-10ecb417-32ab-4326-8a3e-c60215da745e tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7a2409cb-5932-4b9b-ab77-f8bd40a36206" status: 200 len: 287 microversion: 2.1 time: 0.046571 Nov 24 03:11:48.064342 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 475/977] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Nov 24 03:11:48 2021] GET /compute/v2.1/os-snapshots/7a2409cb-5932-4b9b-ab77-f8bd40a36206 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:11:48.205226 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c1087060-2833-4851-8294-d36a6f5d5e2e tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:48.205823 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c1087060-2833-4851-8294-d36a6f5d5e2e tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:48.212370 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c1087060-2833-4851-8294-d36a6f5d5e2e tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:48.212829 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c1087060-2833-4851-8294-d36a6f5d5e2e tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:48.213621 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c1087060-2833-4851-8294-d36a6f5d5e2e tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:48.214087 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c1087060-2833-4851-8294-d36a6f5d5e2e tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:48.283575 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c1087060-2833-4851-8294-d36a6f5d5e2e tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:48.292201 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c1087060-2833-4851-8294-d36a6f5d5e2e tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de" status: 200 len: 1223 microversion: 2.1 time: 0.090988 Nov 24 03:11:48.292788 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 503/978] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:48 2021] GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:11:49.052831 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-99aea10b-e580-4ac2-b7e4-487375036213 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:49.054222 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-99aea10b-e580-4ac2-b7e4-487375036213 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:49.061897 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-99aea10b-e580-4ac2-b7e4-487375036213 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:49.062678 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-99aea10b-e580-4ac2-b7e4-487375036213 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:49.064096 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-99aea10b-e580-4ac2-b7e4-487375036213 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:49.064993 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-99aea10b-e580-4ac2-b7e4-487375036213 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:49.091725 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c1495bd8-bc98-4f3c-aa33-f097c92c828d tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Calling method '.version_select at 0x7f7a2dceadc0>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:49.115396 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-99aea10b-e580-4ac2-b7e4-487375036213 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:49.116994 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-99aea10b-e580-4ac2-b7e4-487375036213 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:49.118320 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-99aea10b-e580-4ac2-b7e4-487375036213 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lazy-loading 'fault' on Instance uuid 262867ad-b362-4696-9425-81751e68d74f {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:11:49.150007 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c1495bd8-bc98-4f3c-aa33-f097c92c828d tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7a2409cb-5932-4b9b-ab77-f8bd40a36206" status: 200 len: 288 microversion: 2.1 time: 0.076727 Nov 24 03:11:49.151109 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 504/979] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Nov 24 03:11:49 2021] GET /compute/v2.1/os-snapshots/7a2409cb-5932-4b9b-ab77-f8bd40a36206 => generated 288 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:11:49.162822 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-27f3f978-4415-4f73-98c0-fdaef223c6e8 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Calling method '.version_select at 0x7f7a2dd17280>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:49.233597 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-99aea10b-e580-4ac2-b7e4-487375036213 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848fe17e3a994374a7a30d38ed5e3299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5a7594dcfc4cc6b0e9d09a768fd72f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:49.254998 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-99aea10b-e580-4ac2-b7e4-487375036213 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 200 len: 1225 microversion: 2.1 time: 0.206883 Nov 24 03:11:49.256150 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 476/980] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:49 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 1225 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:11:49.311881 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-27f3f978-4415-4f73-98c0-fdaef223c6e8 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/7a2409cb-5932-4b9b-ab77-f8bd40a36206" status: 202 len: 0 microversion: 2.1 time: 0.149814 Nov 24 03:11:49.317601 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 505/981] 10.222.0.52 () {58 vars in 1253 bytes} [Wed Nov 24 03:11:49 2021] DELETE /compute/v2.1/os-snapshots/7a2409cb-5932-4b9b-ab77-f8bd40a36206 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:11:49.323634 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-dc1c137e-5c52-44f0-a6b6-46698fe97e1c tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:49.327650 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-dc1c137e-5c52-44f0-a6b6-46698fe97e1c tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:49.332484 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-cd17ad21-11e8-4bae-8f94-a9b8cfca421f tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Calling method '.version_select at 0x7f7a2dcae790>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:49.353207 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dc1c137e-5c52-44f0-a6b6-46698fe97e1c tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:49.353834 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dc1c137e-5c52-44f0-a6b6-46698fe97e1c tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:49.354867 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dc1c137e-5c52-44f0-a6b6-46698fe97e1c tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:49.355464 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dc1c137e-5c52-44f0-a6b6-46698fe97e1c tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:49.396424 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-cd17ad21-11e8-4bae-8f94-a9b8cfca421f tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7a2409cb-5932-4b9b-ab77-f8bd40a36206" status: 200 len: 287 microversion: 2.1 time: 0.070711 Nov 24 03:11:49.404160 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 506/982] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Nov 24 03:11:49 2021] GET /compute/v2.1/os-snapshots/7a2409cb-5932-4b9b-ab77-f8bd40a36206 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:11:49.547233 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-dc1c137e-5c52-44f0-a6b6-46698fe97e1c tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:49.560911 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-dc1c137e-5c52-44f0-a6b6-46698fe97e1c tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de" status: 200 len: 1277 microversion: 2.1 time: 0.253503 Nov 24 03:11:49.562011 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 477/983] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:49 2021] GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de => generated 1277 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:11:50.295396 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-fc3eab34-a46b-4116-aa6a-284607c8204f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:50.296609 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-fc3eab34-a46b-4116-aa6a-284607c8204f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] [instance: 262867ad-b362-4696-9425-81751e68d74f] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:50.307401 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fc3eab34-a46b-4116-aa6a-284607c8204f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:50.308123 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fc3eab34-a46b-4116-aa6a-284607c8204f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:50.309539 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fc3eab34-a46b-4116-aa6a-284607c8204f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:50.310284 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-fc3eab34-a46b-4116-aa6a-284607c8204f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:50.335829 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-fc3eab34-a46b-4116-aa6a-284607c8204f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] HTTP exception thrown: Instance 262867ad-b362-4696-9425-81751e68d74f could not be found. Nov 24 03:11:50.336836 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-fc3eab34-a46b-4116-aa6a-284607c8204f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Returning 404 to user: Instance 262867ad-b362-4696-9425-81751e68d74f could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:11:50.338342 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-fc3eab34-a46b-4116-aa6a-284607c8204f tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f" status: 404 len: 111 microversion: 2.1 time: 0.050451 Nov 24 03:11:50.339463 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 507/984] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:50 2021] GET /compute/v2.1/servers/262867ad-b362-4696-9425-81751e68d74f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:11:50.415098 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-31ac7bd8-f3d7-4709-98cb-3730a55c425a tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Calling method '.version_select at 0x7f7a2ea70c10>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:50.449135 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-31ac7bd8-f3d7-4709-98cb-3730a55c425a tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] HTTP exception thrown: Snapshot 7a2409cb-5932-4b9b-ab77-f8bd40a36206 could not be found. Nov 24 03:11:50.450355 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-31ac7bd8-f3d7-4709-98cb-3730a55c425a tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Returning 404 to user: Snapshot 7a2409cb-5932-4b9b-ab77-f8bd40a36206 could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:11:50.451480 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-31ac7bd8-f3d7-4709-98cb-3730a55c425a tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7a2409cb-5932-4b9b-ab77-f8bd40a36206" status: 404 len: 111 microversion: 2.1 time: 0.044392 Nov 24 03:11:50.456046 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 478/985] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Nov 24 03:11:50 2021] GET /compute/v2.1/os-snapshots/7a2409cb-5932-4b9b-ab77-f8bd40a36206 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:11:50.461278 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-574fb9f4-6e4e-42df-9bd1-3aafa61c1698 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Calling method '.version_select at 0x7f7a2dd58b80>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:50.565366 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-574fb9f4-6e4e-42df-9bd1-3aafa61c1698 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/da55637e-5b1e-425a-aad9-0bc23a798757" status: 202 len: 0 microversion: 2.1 time: 0.106437 Nov 24 03:11:50.571061 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 508/986] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Nov 24 03:11:50 2021] DELETE /compute/v2.1/os-volumes/da55637e-5b1e-425a-aad9-0bc23a798757 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 03:11:50.577497 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-56c3da3c-622c-4ac8-ac92-10a00053a682 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Calling method '.version_select at 0x7f7a2ddeb940>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:50.589799 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4cfe669c-bd0a-4cb9-892b-f76705144080 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:50.591018 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4cfe669c-bd0a-4cb9-892b-f76705144080 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:50.604485 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4cfe669c-bd0a-4cb9-892b-f76705144080 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:50.605167 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4cfe669c-bd0a-4cb9-892b-f76705144080 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:50.606011 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4cfe669c-bd0a-4cb9-892b-f76705144080 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:50.606457 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4cfe669c-bd0a-4cb9-892b-f76705144080 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:50.692061 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-56c3da3c-622c-4ac8-ac92-10a00053a682 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/da55637e-5b1e-425a-aad9-0bc23a798757" status: 200 len: 344 microversion: 2.1 time: 0.118905 Nov 24 03:11:50.694374 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 479/987] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Nov 24 03:11:50 2021] GET /compute/v2.1/os-volumes/da55637e-5b1e-425a-aad9-0bc23a798757 => generated 344 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:11:50.708270 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1bb46bf5-3c4e-479c-b56f-2e94840701a4 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] Calling method '.version_select at 0x7f7a2de405e0>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:50.752073 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1bb46bf5-3c4e-479c-b56f-2e94840701a4 tempest-TestShelveInstance-1104150990 tempest-TestShelveInstance-1104150990-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1838051711" status: 202 len: 0 microversion: 2.1 time: 0.052869 Nov 24 03:11:50.754209 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 480/988] 10.222.0.52 () {58 vars in 1253 bytes} [Wed Nov 24 03:11:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1838051711 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:11:50.861777 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4cfe669c-bd0a-4cb9-892b-f76705144080 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:50.875125 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4cfe669c-bd0a-4cb9-892b-f76705144080 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de" status: 200 len: 1319 microversion: 2.1 time: 0.289033 Nov 24 03:11:50.876619 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 509/989] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:50 2021] GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:11:51.622254 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-1676f573-687f-4b72-8c7f-234f3cfc926c req-63e1591c-4242-434f-9ec9-7170a51ada40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89763893-9a56-4992-9153-7554355e52de", "tag": "49298d89-755e-4799-975d-25efac33a05c"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:11:51.625879 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:11:51.625879 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:11:51.652003 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-1676f573-687f-4b72-8c7f-234f3cfc926c req-63e1591c-4242-434f-9ec9-7170a51ada40 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:51.652396 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-1676f573-687f-4b72-8c7f-234f3cfc926c req-63e1591c-4242-434f-9ec9-7170a51ada40 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:51.671392 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-1676f573-687f-4b72-8c7f-234f3cfc926c req-63e1591c-4242-434f-9ec9-7170a51ada40 service nova] Creating event network-changed:49298d89-755e-4799-975d-25efac33a05c for instance 89763893-9a56-4992-9153-7554355e52de on hv-cinder-81803 Nov 24 03:11:51.680226 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-1676f573-687f-4b72-8c7f-234f3cfc926c req-63e1591c-4242-434f-9ec9-7170a51ada40 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064574 Nov 24 03:11:51.680934 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 481/990] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:11:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:11:51.715222 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ca68ca23-4eeb-4152-920c-0070df9408ee tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Calling method '.version_select at 0x7f7a2dd810d0>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:51.750915 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-ca68ca23-4eeb-4152-920c-0070df9408ee tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] HTTP exception thrown: Volume da55637e-5b1e-425a-aad9-0bc23a798757 could not be found. Nov 24 03:11:51.751874 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ca68ca23-4eeb-4152-920c-0070df9408ee tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Returning 404 to user: Volume da55637e-5b1e-425a-aad9-0bc23a798757 could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:11:51.753251 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ca68ca23-4eeb-4152-920c-0070df9408ee tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/da55637e-5b1e-425a-aad9-0bc23a798757" status: 404 len: 109 microversion: 2.1 time: 0.046550 Nov 24 03:11:51.754308 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 510/991] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Nov 24 03:11:51 2021] GET /compute/v2.1/os-volumes/da55637e-5b1e-425a-aad9-0bc23a798757 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:11:51.773358 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0a1b3ad9-716b-4a54-9050-7b697c371a94 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Calling method '.version_select at 0x7f7a2de76af0>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:51.812053 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-0a1b3ad9-716b-4a54-9050-7b697c371a94 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] HTTP exception thrown: Volume da55637e-5b1e-425a-aad9-0bc23a798757 could not be found. Nov 24 03:11:51.813032 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0a1b3ad9-716b-4a54-9050-7b697c371a94 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Returning 404 to user: Volume da55637e-5b1e-425a-aad9-0bc23a798757 could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:11:51.814353 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0a1b3ad9-716b-4a54-9050-7b697c371a94 tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/da55637e-5b1e-425a-aad9-0bc23a798757" status: 404 len: 109 microversion: 2.1 time: 0.048831 Nov 24 03:11:51.815231 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 482/992] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Nov 24 03:11:51 2021] DELETE /compute/v2.1/os-volumes/da55637e-5b1e-425a-aad9-0bc23a798757 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:11:51.823801 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7a99539a-c564-4cff-964a-23b389bae23e tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Calling method '.version_select at 0x7f7a2dccd820>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:51.855060 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-7a99539a-c564-4cff-964a-23b389bae23e tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] HTTP exception thrown: Volume da55637e-5b1e-425a-aad9-0bc23a798757 could not be found. Nov 24 03:11:51.855683 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7a99539a-c564-4cff-964a-23b389bae23e tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] Returning 404 to user: Volume da55637e-5b1e-425a-aad9-0bc23a798757 could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:11:51.856536 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7a99539a-c564-4cff-964a-23b389bae23e tempest-VolumesSnapshotsTestJSON-1945422126 tempest-VolumesSnapshotsTestJSON-1945422126-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/da55637e-5b1e-425a-aad9-0bc23a798757" status: 404 len: 109 microversion: 2.1 time: 0.036533 Nov 24 03:11:51.857092 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 511/993] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Nov 24 03:11:51 2021] GET /compute/v2.1/os-volumes/da55637e-5b1e-425a-aad9-0bc23a798757 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:11:51.899684 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b5b5b665-9348-4c99-b9a6-dfa7f78fb413 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:51.900423 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b5b5b665-9348-4c99-b9a6-dfa7f78fb413 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:51.909302 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b5b5b665-9348-4c99-b9a6-dfa7f78fb413 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:51.910116 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b5b5b665-9348-4c99-b9a6-dfa7f78fb413 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:51.911204 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b5b5b665-9348-4c99-b9a6-dfa7f78fb413 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:51.911675 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b5b5b665-9348-4c99-b9a6-dfa7f78fb413 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:52.240759 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b5b5b665-9348-4c99-b9a6-dfa7f78fb413 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:52.251523 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b5b5b665-9348-4c99-b9a6-dfa7f78fb413 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de" status: 200 len: 1319 microversion: 2.1 time: 0.355761 Nov 24 03:11:52.260338 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 483/994] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:51 2021] GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:11:53.290123 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b38746f6-a011-47fb-8bd6-87de883f7c98 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:53.292346 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b38746f6-a011-47fb-8bd6-87de883f7c98 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:53.307586 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b38746f6-a011-47fb-8bd6-87de883f7c98 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:53.308500 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b38746f6-a011-47fb-8bd6-87de883f7c98 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:53.310799 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b38746f6-a011-47fb-8bd6-87de883f7c98 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:53.311705 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b38746f6-a011-47fb-8bd6-87de883f7c98 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:53.497322 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b38746f6-a011-47fb-8bd6-87de883f7c98 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:53.509695 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b38746f6-a011-47fb-8bd6-87de883f7c98 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de" status: 200 len: 1319 microversion: 2.1 time: 0.236552 Nov 24 03:11:53.521982 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 512/995] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:53 2021] GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:11:54.562132 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-cf3b2a8a-d2cb-48e8-b8ed-b212478602c9 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:54.569514 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-cf3b2a8a-d2cb-48e8-b8ed-b212478602c9 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:54.593236 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cf3b2a8a-d2cb-48e8-b8ed-b212478602c9 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:54.594237 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cf3b2a8a-d2cb-48e8-b8ed-b212478602c9 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:54.605831 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cf3b2a8a-d2cb-48e8-b8ed-b212478602c9 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:54.606862 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cf3b2a8a-d2cb-48e8-b8ed-b212478602c9 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:54.937780 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-cf3b2a8a-d2cb-48e8-b8ed-b212478602c9 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:54.951587 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-cf3b2a8a-d2cb-48e8-b8ed-b212478602c9 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de" status: 200 len: 1319 microversion: 2.1 time: 0.418612 Nov 24 03:11:54.954613 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 484/996] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:54 2021] GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de => generated 1319 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:11:55.980581 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b7c817db-a419-4acb-a72b-b982ec844091 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:55.981543 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b7c817db-a419-4acb-a72b-b982ec844091 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:55.994350 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b7c817db-a419-4acb-a72b-b982ec844091 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:55.994920 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b7c817db-a419-4acb-a72b-b982ec844091 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:55.996336 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b7c817db-a419-4acb-a72b-b982ec844091 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:55.997062 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b7c817db-a419-4acb-a72b-b982ec844091 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:56.267505 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b7c817db-a419-4acb-a72b-b982ec844091 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:56.276640 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b7c817db-a419-4acb-a72b-b982ec844091 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de" status: 200 len: 1319 microversion: 2.1 time: 0.303000 Nov 24 03:11:56.277247 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 513/997] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:55 2021] GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:11:56.878519 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-8fd6e739-d5a3-47d6-9f0a-6d4e8cd3b7ec req-30ae6c30-5f66-41ff-a08a-069208138894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89763893-9a56-4992-9153-7554355e52de", "name": "network-vif-plugged", "status": "completed", "tag": "49298d89-755e-4799-975d-25efac33a05c"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:11:56.881603 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:11:56.881603 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:11:56.909535 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-8fd6e739-d5a3-47d6-9f0a-6d4e8cd3b7ec req-30ae6c30-5f66-41ff-a08a-069208138894 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:56.910784 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-8fd6e739-d5a3-47d6-9f0a-6d4e8cd3b7ec req-30ae6c30-5f66-41ff-a08a-069208138894 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:56.939977 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-8fd6e739-d5a3-47d6-9f0a-6d4e8cd3b7ec req-30ae6c30-5f66-41ff-a08a-069208138894 service nova] Creating event network-vif-plugged:49298d89-755e-4799-975d-25efac33a05c for instance 89763893-9a56-4992-9153-7554355e52de on hv-cinder-81803 Nov 24 03:11:56.958151 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-8fd6e739-d5a3-47d6-9f0a-6d4e8cd3b7ec req-30ae6c30-5f66-41ff-a08a-069208138894 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083822 Nov 24 03:11:56.958850 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 485/998] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:11:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:11:57.305103 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-cb0138a2-4969-4261-859f-2ab20d48a4c1 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:57.305940 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-cb0138a2-4969-4261-859f-2ab20d48a4c1 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:57.322476 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb0138a2-4969-4261-859f-2ab20d48a4c1 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:57.323094 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb0138a2-4969-4261-859f-2ab20d48a4c1 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:57.326992 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb0138a2-4969-4261-859f-2ab20d48a4c1 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:57.330113 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb0138a2-4969-4261-859f-2ab20d48a4c1 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:57.618205 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-cb0138a2-4969-4261-859f-2ab20d48a4c1 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:57.649975 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-cb0138a2-4969-4261-859f-2ab20d48a4c1 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de" status: 200 len: 1319 microversion: 2.1 time: 0.350503 Nov 24 03:11:57.655267 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 514/999] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:57 2021] GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:11:58.674309 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-17fd71c0-208b-4bbb-bb14-dfb544abc50f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:11:58.675161 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-17fd71c0-208b-4bbb-bb14-dfb544abc50f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:11:58.682352 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-17fd71c0-208b-4bbb-bb14-dfb544abc50f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:58.682845 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-17fd71c0-208b-4bbb-bb14-dfb544abc50f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:58.683645 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-17fd71c0-208b-4bbb-bb14-dfb544abc50f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:11:58.684079 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-17fd71c0-208b-4bbb-bb14-dfb544abc50f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:11:59.003567 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-17fd71c0-208b-4bbb-bb14-dfb544abc50f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:11:59.015936 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-17fd71c0-208b-4bbb-bb14-dfb544abc50f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de" status: 200 len: 1508 microversion: 2.1 time: 0.346552 Nov 24 03:11:59.016811 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 486/1000] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:11:58 2021] GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:16.517119 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-42e86871-7085-4ab8-9a15-5fce9fe3af09 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51a85782-9409-47c7-977e-80a9ef4262b9", "device": "/dev/sdb"}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:12:16.518792 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-42e86871-7085-4ab8-9a15-5fce9fe3af09 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:16.525350 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-42e86871-7085-4ab8-9a15-5fce9fe3af09 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:16.525979 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-42e86871-7085-4ab8-9a15-5fce9fe3af09 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:16.526823 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-42e86871-7085-4ab8-9a15-5fce9fe3af09 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:16.527222 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-42e86871-7085-4ab8-9a15-5fce9fe3af09 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:16.785167 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-42e86871-7085-4ab8-9a15-5fce9fe3af09 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "POST /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272093 Nov 24 03:12:16.785788 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 515/1001] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Nov 24 03:12:16 2021] POST /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:12:42.607935 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4e95a92d-8e2f-4a0e-ba78-9a5e0a3a5557 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:42.608497 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4e95a92d-8e2f-4a0e-ba78-9a5e0a3a5557 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:42.615067 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e95a92d-8e2f-4a0e-ba78-9a5e0a3a5557 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:42.615527 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e95a92d-8e2f-4a0e-ba78-9a5e0a3a5557 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:42.616435 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e95a92d-8e2f-4a0e-ba78-9a5e0a3a5557 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:42.616861 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e95a92d-8e2f-4a0e-ba78-9a5e0a3a5557 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:42.651678 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2b4391fa-6f40-40d7-bad2-475856185cd7 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2056526957", "imageRef": "04860a4a-47c3-4532-865d-be6c9c493af7", "flavorRef": "452"}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:12:42.696820 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-4e95a92d-8e2f-4a0e-ba78-9a5e0a3a5557 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lazy-loading 'services' on Instance uuid 89763893-9a56-4992-9153-7554355e52de {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:12:42.702692 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.network.neutron [None req-2b4391fa-6f40-40d7-bad2-475856185cd7 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] validate_networks() for None {{(pid=116331) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:12:42.772818 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4e95a92d-8e2f-4a0e-ba78-9a5e0a3a5557 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "DELETE /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de/os-volume_attachments/51a85782-9409-47c7-977e-80a9ef4262b9" status: 202 len: 0 microversion: 2.1 time: 0.168472 Nov 24 03:12:42.773552 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 487/1002] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Nov 24 03:12:42 2021] DELETE /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de/os-volume_attachments/51a85782-9409-47c7-977e-80a9ef4262b9 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:12:43.010320 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-2b4391fa-6f40-40d7-bad2-475856185cd7 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Flavor limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:12:43.010739 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-2b4391fa-6f40-40d7-bad2-475856185cd7 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Image limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:12:43.011210 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-2b4391fa-6f40-40d7-bad2-475856185cd7 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Flavor pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:12:43.011610 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-2b4391fa-6f40-40d7-bad2-475856185cd7 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Image pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:12:43.012019 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-2b4391fa-6f40-40d7-bad2-475856185cd7 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:12:43.021373 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2b4391fa-6f40-40d7-bad2-475856185cd7 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:43.021932 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2b4391fa-6f40-40d7-bad2-475856185cd7 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:43.023348 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2b4391fa-6f40-40d7-bad2-475856185cd7 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:43.023786 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2b4391fa-6f40-40d7-bad2-475856185cd7 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:43.041700 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-2b4391fa-6f40-40d7-bad2-475856185cd7 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Getting quotas for project 9891205dbe2a4c3e8e66cb4d967cba16. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:12:43.046671 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-2b4391fa-6f40-40d7-bad2-475856185cd7 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Getting quotas for user adce5d1a239947f682e14646db95a814 and project 9891205dbe2a4c3e8e66cb4d967cba16. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:12:43.059957 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2b4391fa-6f40-40d7-bad2-475856185cd7 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Going to run 1 instances... {{(pid=116331) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:12:43.062516 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2b4391fa-6f40-40d7-bad2-475856185cd7 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] [instance: 07fdfafa-db95-4596-96be-1ec4c766d918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04860a4a-47c3-4532-865d-be6c9c493af7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:12:43.114174 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2b4391fa-6f40-40d7-bad2-475856185cd7 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.466361 Nov 24 03:12:43.114826 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 516/1003] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Nov 24 03:12:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 03:12:43.125246 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4be2d1d5-ed9d-4da7-bc6f-26e03fe16729 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:43.125952 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4be2d1d5-ed9d-4da7-bc6f-26e03fe16729 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] [instance: 07fdfafa-db95-4596-96be-1ec4c766d918] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:43.189865 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4be2d1d5-ed9d-4da7-bc6f-26e03fe16729 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adce5d1a239947f682e14646db95a814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9891205dbe2a4c3e8e66cb4d967cba16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:43.196855 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4be2d1d5-ed9d-4da7-bc6f-26e03fe16729 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] 10.222.0.52 "GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918" status: 200 len: 1215 microversion: 2.1 time: 0.075632 Nov 24 03:12:43.198002 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 488/1004] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:43 2021] GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918 => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:43.892726 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-76bdcd34-bbae-403b-b4b3-37ecf35dd9a2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:43.893289 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-76bdcd34-bbae-403b-b4b3-37ecf35dd9a2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:43.901197 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-76bdcd34-bbae-403b-b4b3-37ecf35dd9a2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:43.901654 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-76bdcd34-bbae-403b-b4b3-37ecf35dd9a2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:43.902485 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-76bdcd34-bbae-403b-b4b3-37ecf35dd9a2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:43.902956 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-76bdcd34-bbae-403b-b4b3-37ecf35dd9a2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:43.929559 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-76bdcd34-bbae-403b-b4b3-37ecf35dd9a2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] Going to try to terminate instance {{(pid=116331) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:12:44.014848 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-76bdcd34-bbae-403b-b4b3-37ecf35dd9a2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "DELETE /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de" status: 204 len: 0 microversion: 2.1 time: 0.126692 Nov 24 03:12:44.015555 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 517/1005] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:12:43 2021] DELETE /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 03:12:44.024949 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c397d296-4a1c-43d9-bc47-ae3fb2dd9d38 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:44.025986 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c397d296-4a1c-43d9-bc47-ae3fb2dd9d38 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:44.032526 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c397d296-4a1c-43d9-bc47-ae3fb2dd9d38 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:44.032976 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c397d296-4a1c-43d9-bc47-ae3fb2dd9d38 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:44.033741 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c397d296-4a1c-43d9-bc47-ae3fb2dd9d38 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:44.034215 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c397d296-4a1c-43d9-bc47-ae3fb2dd9d38 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:44.177823 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c397d296-4a1c-43d9-bc47-ae3fb2dd9d38 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:44.186352 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c397d296-4a1c-43d9-bc47-ae3fb2dd9d38 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de" status: 200 len: 1514 microversion: 2.1 time: 0.166183 Nov 24 03:12:44.186967 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 489/1006] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:44 2021] GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:44.215990 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b38ce66c-9a75-4389-8ee5-30fcbfb48d3b tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:44.216471 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b38ce66c-9a75-4389-8ee5-30fcbfb48d3b tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] [instance: 07fdfafa-db95-4596-96be-1ec4c766d918] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:44.224349 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b38ce66c-9a75-4389-8ee5-30fcbfb48d3b tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:44.224857 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b38ce66c-9a75-4389-8ee5-30fcbfb48d3b tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:44.226089 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b38ce66c-9a75-4389-8ee5-30fcbfb48d3b tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:44.226755 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b38ce66c-9a75-4389-8ee5-30fcbfb48d3b tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:44.297011 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b38ce66c-9a75-4389-8ee5-30fcbfb48d3b tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adce5d1a239947f682e14646db95a814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9891205dbe2a4c3e8e66cb4d967cba16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:44.305621 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b38ce66c-9a75-4389-8ee5-30fcbfb48d3b tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] 10.222.0.52 "GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918" status: 200 len: 1267 microversion: 2.1 time: 0.094793 Nov 24 03:12:44.306847 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 518/1007] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:44 2021] GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918 => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:45.203804 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-00430497-fbab-451b-b917-3076db2572f2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:45.204703 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-00430497-fbab-451b-b917-3076db2572f2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:45.211563 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-00430497-fbab-451b-b917-3076db2572f2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:45.212020 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-00430497-fbab-451b-b917-3076db2572f2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:45.218700 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-00430497-fbab-451b-b917-3076db2572f2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:45.219475 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-00430497-fbab-451b-b917-3076db2572f2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:45.323950 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-869deab4-bbf3-4509-a0b6-59e0ebcaa61d tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:45.324595 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-869deab4-bbf3-4509-a0b6-59e0ebcaa61d tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] [instance: 07fdfafa-db95-4596-96be-1ec4c766d918] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:45.331310 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-869deab4-bbf3-4509-a0b6-59e0ebcaa61d tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:45.331943 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-869deab4-bbf3-4509-a0b6-59e0ebcaa61d tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:45.334705 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-869deab4-bbf3-4509-a0b6-59e0ebcaa61d tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:45.335230 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-869deab4-bbf3-4509-a0b6-59e0ebcaa61d tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:45.480762 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-00430497-fbab-451b-b917-3076db2572f2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:45.481261 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-869deab4-bbf3-4509-a0b6-59e0ebcaa61d tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adce5d1a239947f682e14646db95a814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9891205dbe2a4c3e8e66cb4d967cba16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:45.488883 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-869deab4-bbf3-4509-a0b6-59e0ebcaa61d tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] 10.222.0.52 "GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918" status: 200 len: 1315 microversion: 2.1 time: 0.168907 Nov 24 03:12:45.489104 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-00430497-fbab-451b-b917-3076db2572f2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de" status: 200 len: 1514 microversion: 2.1 time: 0.289125 Nov 24 03:12:45.489484 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 519/1008] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:45 2021] GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:12:45.498697 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 490/1009] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:45 2021] GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de => generated 1514 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:45.936003 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-e9e01236-e8dd-4a8b-8eec-bb13f14c124d req-943ca2f7-58ba-4e49-81b1-59f07159d7db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07fdfafa-db95-4596-96be-1ec4c766d918", "tag": "c27c89ad-706c-495d-8927-3a0b890861b0"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:12:45.937709 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:12:45.937709 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:12:45.954834 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-e9e01236-e8dd-4a8b-8eec-bb13f14c124d req-943ca2f7-58ba-4e49-81b1-59f07159d7db service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:45.955633 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-e9e01236-e8dd-4a8b-8eec-bb13f14c124d req-943ca2f7-58ba-4e49-81b1-59f07159d7db service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:45.970927 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-e9e01236-e8dd-4a8b-8eec-bb13f14c124d req-943ca2f7-58ba-4e49-81b1-59f07159d7db service nova] Creating event network-changed:c27c89ad-706c-495d-8927-3a0b890861b0 for instance 07fdfafa-db95-4596-96be-1ec4c766d918 on hv-cinder-81803 Nov 24 03:12:45.976936 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-e9e01236-e8dd-4a8b-8eec-bb13f14c124d req-943ca2f7-58ba-4e49-81b1-59f07159d7db service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049962 Nov 24 03:12:45.985790 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 491/1010] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:12:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:12:46.178436 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-4d50af8d-105f-49da-a5d5-b681dd1a310a req-6d2e2478-d04c-44f3-9348-363fc56a4b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89763893-9a56-4992-9153-7554355e52de", "name": "network-vif-deleted", "tag": "49298d89-755e-4799-975d-25efac33a05c"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:12:46.180605 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:12:46.180605 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:12:46.188127 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-4d50af8d-105f-49da-a5d5-b681dd1a310a req-6d2e2478-d04c-44f3-9348-363fc56a4b57 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:46.188675 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-4d50af8d-105f-49da-a5d5-b681dd1a310a req-6d2e2478-d04c-44f3-9348-363fc56a4b57 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:46.210583 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-4d50af8d-105f-49da-a5d5-b681dd1a310a req-6d2e2478-d04c-44f3-9348-363fc56a4b57 service nova] Creating event network-vif-deleted:49298d89-755e-4799-975d-25efac33a05c for instance 89763893-9a56-4992-9153-7554355e52de on hv-cinder-81803 Nov 24 03:12:46.218336 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-4d50af8d-105f-49da-a5d5-b681dd1a310a req-6d2e2478-d04c-44f3-9348-363fc56a4b57 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044634 Nov 24 03:12:46.219546 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 520/1011] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:12:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:12:46.505929 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-430e0554-f3a7-4586-ac69-69a83b44aa72 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:46.506620 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-430e0554-f3a7-4586-ac69-69a83b44aa72 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:46.506996 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7752a6fa-d6b8-42da-9de6-2fc37505df6c tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:46.507964 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-7752a6fa-d6b8-42da-9de6-2fc37505df6c tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] [instance: 07fdfafa-db95-4596-96be-1ec4c766d918] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:46.514834 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-430e0554-f3a7-4586-ac69-69a83b44aa72 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:46.515046 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7752a6fa-d6b8-42da-9de6-2fc37505df6c tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:46.515283 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-430e0554-f3a7-4586-ac69-69a83b44aa72 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:46.515527 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7752a6fa-d6b8-42da-9de6-2fc37505df6c tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:46.516075 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-430e0554-f3a7-4586-ac69-69a83b44aa72 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:46.516492 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-430e0554-f3a7-4586-ac69-69a83b44aa72 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:46.517261 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7752a6fa-d6b8-42da-9de6-2fc37505df6c tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:46.517851 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7752a6fa-d6b8-42da-9de6-2fc37505df6c tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:46.552527 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-430e0554-f3a7-4586-ac69-69a83b44aa72 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:46.552986 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-430e0554-f3a7-4586-ac69-69a83b44aa72 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:46.553439 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-430e0554-f3a7-4586-ac69-69a83b44aa72 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lazy-loading 'fault' on Instance uuid 89763893-9a56-4992-9153-7554355e52de {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:12:46.603066 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-430e0554-f3a7-4586-ac69-69a83b44aa72 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:46.623808 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-430e0554-f3a7-4586-ac69-69a83b44aa72 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de" status: 200 len: 1309 microversion: 2.1 time: 0.121796 Nov 24 03:12:46.624322 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 492/1012] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:46 2021] GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de => generated 1309 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:46.679989 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7752a6fa-d6b8-42da-9de6-2fc37505df6c tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adce5d1a239947f682e14646db95a814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9891205dbe2a4c3e8e66cb4d967cba16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:46.688158 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7752a6fa-d6b8-42da-9de6-2fc37505df6c tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] 10.222.0.52 "GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918" status: 200 len: 1315 microversion: 2.1 time: 0.185678 Nov 24 03:12:46.688747 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 521/1013] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:46 2021] GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:47.640958 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-55445814-c5ad-4538-bbd7-f855ab33ebc0 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:47.641574 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-55445814-c5ad-4538-bbd7-f855ab33ebc0 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: 89763893-9a56-4992-9153-7554355e52de] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:47.647989 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-55445814-c5ad-4538-bbd7-f855ab33ebc0 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:47.648568 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-55445814-c5ad-4538-bbd7-f855ab33ebc0 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:47.649235 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-55445814-c5ad-4538-bbd7-f855ab33ebc0 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:47.649682 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-55445814-c5ad-4538-bbd7-f855ab33ebc0 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:47.663103 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-55445814-c5ad-4538-bbd7-f855ab33ebc0 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] HTTP exception thrown: Instance 89763893-9a56-4992-9153-7554355e52de could not be found. Nov 24 03:12:47.663681 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-55445814-c5ad-4538-bbd7-f855ab33ebc0 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Returning 404 to user: Instance 89763893-9a56-4992-9153-7554355e52de could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:12:47.664598 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-55445814-c5ad-4538-bbd7-f855ab33ebc0 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de" status: 404 len: 111 microversion: 2.1 time: 0.028002 Nov 24 03:12:47.665224 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 493/1014] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:47 2021] GET /compute/v2.1/servers/89763893-9a56-4992-9153-7554355e52de => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:12:47.705726 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-783ff686-0ed6-4a4a-8653-ca32dad062ad tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:47.706360 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-783ff686-0ed6-4a4a-8653-ca32dad062ad tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] [instance: 07fdfafa-db95-4596-96be-1ec4c766d918] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:47.713028 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-783ff686-0ed6-4a4a-8653-ca32dad062ad tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:47.713477 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-783ff686-0ed6-4a4a-8653-ca32dad062ad tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:47.714285 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-783ff686-0ed6-4a4a-8653-ca32dad062ad tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:47.714693 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-783ff686-0ed6-4a4a-8653-ca32dad062ad tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:47.853522 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-783ff686-0ed6-4a4a-8653-ca32dad062ad tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adce5d1a239947f682e14646db95a814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9891205dbe2a4c3e8e66cb4d967cba16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:47.860958 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-783ff686-0ed6-4a4a-8653-ca32dad062ad tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] 10.222.0.52 "GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918" status: 200 len: 1315 microversion: 2.1 time: 0.158864 Nov 24 03:12:47.861592 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 522/1015] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:47 2021] GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:48.877878 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6050aead-8f3c-4d9a-8629-0d1ca71d6fba tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:48.878544 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6050aead-8f3c-4d9a-8629-0d1ca71d6fba tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] [instance: 07fdfafa-db95-4596-96be-1ec4c766d918] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:48.885666 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6050aead-8f3c-4d9a-8629-0d1ca71d6fba tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:48.886153 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6050aead-8f3c-4d9a-8629-0d1ca71d6fba tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:48.886958 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6050aead-8f3c-4d9a-8629-0d1ca71d6fba tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:48.887397 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6050aead-8f3c-4d9a-8629-0d1ca71d6fba tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:49.045713 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6050aead-8f3c-4d9a-8629-0d1ca71d6fba tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adce5d1a239947f682e14646db95a814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9891205dbe2a4c3e8e66cb4d967cba16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:49.054877 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6050aead-8f3c-4d9a-8629-0d1ca71d6fba tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] 10.222.0.52 "GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918" status: 200 len: 1315 microversion: 2.1 time: 0.180697 Nov 24 03:12:49.055526 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 494/1016] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:48 2021] GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:50.074040 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ee2d692c-c777-4b1a-aa3b-8a3b03471460 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:50.074675 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ee2d692c-c777-4b1a-aa3b-8a3b03471460 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] [instance: 07fdfafa-db95-4596-96be-1ec4c766d918] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:50.081306 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ee2d692c-c777-4b1a-aa3b-8a3b03471460 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:50.081743 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ee2d692c-c777-4b1a-aa3b-8a3b03471460 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:50.082566 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ee2d692c-c777-4b1a-aa3b-8a3b03471460 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:50.082998 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ee2d692c-c777-4b1a-aa3b-8a3b03471460 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:50.237349 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ee2d692c-c777-4b1a-aa3b-8a3b03471460 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adce5d1a239947f682e14646db95a814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9891205dbe2a4c3e8e66cb4d967cba16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:50.245322 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ee2d692c-c777-4b1a-aa3b-8a3b03471460 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] 10.222.0.52 "GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918" status: 200 len: 1315 microversion: 2.1 time: 0.175076 Nov 24 03:12:50.245905 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 523/1017] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:50 2021] GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:51.263358 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8d14253a-3295-4c2c-a3a0-fec2f19c0d48 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:51.264356 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8d14253a-3295-4c2c-a3a0-fec2f19c0d48 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] [instance: 07fdfafa-db95-4596-96be-1ec4c766d918] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:51.271039 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8d14253a-3295-4c2c-a3a0-fec2f19c0d48 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:51.271492 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8d14253a-3295-4c2c-a3a0-fec2f19c0d48 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:51.272283 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8d14253a-3295-4c2c-a3a0-fec2f19c0d48 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:51.272717 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8d14253a-3295-4c2c-a3a0-fec2f19c0d48 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:51.415700 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8d14253a-3295-4c2c-a3a0-fec2f19c0d48 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adce5d1a239947f682e14646db95a814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9891205dbe2a4c3e8e66cb4d967cba16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:51.426698 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8d14253a-3295-4c2c-a3a0-fec2f19c0d48 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] 10.222.0.52 "GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918" status: 200 len: 1315 microversion: 2.1 time: 0.166670 Nov 24 03:12:51.427504 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 495/1018] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:51 2021] GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:52.443865 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4cc69620-beeb-42a0-9f8e-808fac4b5bb1 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:52.444470 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4cc69620-beeb-42a0-9f8e-808fac4b5bb1 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] [instance: 07fdfafa-db95-4596-96be-1ec4c766d918] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:52.451033 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4cc69620-beeb-42a0-9f8e-808fac4b5bb1 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:52.451455 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4cc69620-beeb-42a0-9f8e-808fac4b5bb1 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:52.452254 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4cc69620-beeb-42a0-9f8e-808fac4b5bb1 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:52.452716 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4cc69620-beeb-42a0-9f8e-808fac4b5bb1 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:52.588208 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4cc69620-beeb-42a0-9f8e-808fac4b5bb1 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adce5d1a239947f682e14646db95a814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9891205dbe2a4c3e8e66cb4d967cba16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:52.595765 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4cc69620-beeb-42a0-9f8e-808fac4b5bb1 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] 10.222.0.52 "GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918" status: 200 len: 1315 microversion: 2.1 time: 0.155723 Nov 24 03:12:52.596334 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 524/1019] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:52 2021] GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:53.554407 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-db4bd05c-1ac2-4d2e-a7b5-2be15f443d97 req-f130cdd7-cb3e-4595-a262-b359992401ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07fdfafa-db95-4596-96be-1ec4c766d918", "name": "network-vif-plugged", "status": "completed", "tag": "c27c89ad-706c-495d-8927-3a0b890861b0"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:12:53.555958 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:12:53.555958 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:12:53.564307 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-db4bd05c-1ac2-4d2e-a7b5-2be15f443d97 req-f130cdd7-cb3e-4595-a262-b359992401ca service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:53.564778 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-db4bd05c-1ac2-4d2e-a7b5-2be15f443d97 req-f130cdd7-cb3e-4595-a262-b359992401ca service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:53.577188 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-db4bd05c-1ac2-4d2e-a7b5-2be15f443d97 req-f130cdd7-cb3e-4595-a262-b359992401ca service nova] Creating event network-vif-plugged:c27c89ad-706c-495d-8927-3a0b890861b0 for instance 07fdfafa-db95-4596-96be-1ec4c766d918 on hv-cinder-81803 Nov 24 03:12:53.582201 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-db4bd05c-1ac2-4d2e-a7b5-2be15f443d97 req-f130cdd7-cb3e-4595-a262-b359992401ca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031524 Nov 24 03:12:53.582797 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 496/1020] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:12:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:12:53.612540 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b578e14b-1d2a-45bc-88b6-79febe7a188c tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:53.613148 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b578e14b-1d2a-45bc-88b6-79febe7a188c tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] [instance: 07fdfafa-db95-4596-96be-1ec4c766d918] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:53.620436 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b578e14b-1d2a-45bc-88b6-79febe7a188c tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:53.620886 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b578e14b-1d2a-45bc-88b6-79febe7a188c tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:53.621684 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b578e14b-1d2a-45bc-88b6-79febe7a188c tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:53.622155 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b578e14b-1d2a-45bc-88b6-79febe7a188c tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:53.767233 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b578e14b-1d2a-45bc-88b6-79febe7a188c tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adce5d1a239947f682e14646db95a814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9891205dbe2a4c3e8e66cb4d967cba16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:53.775883 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b578e14b-1d2a-45bc-88b6-79febe7a188c tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] 10.222.0.52 "GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918" status: 200 len: 1315 microversion: 2.1 time: 0.166922 Nov 24 03:12:53.776409 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 525/1021] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:53 2021] GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:54.795355 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b54d7aff-3cd1-4813-9cbb-e30f399184e9 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:54.796002 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b54d7aff-3cd1-4813-9cbb-e30f399184e9 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] [instance: 07fdfafa-db95-4596-96be-1ec4c766d918] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:54.802982 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b54d7aff-3cd1-4813-9cbb-e30f399184e9 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:54.803482 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b54d7aff-3cd1-4813-9cbb-e30f399184e9 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:54.804258 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b54d7aff-3cd1-4813-9cbb-e30f399184e9 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:54.804704 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b54d7aff-3cd1-4813-9cbb-e30f399184e9 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:54.956733 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b54d7aff-3cd1-4813-9cbb-e30f399184e9 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adce5d1a239947f682e14646db95a814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9891205dbe2a4c3e8e66cb4d967cba16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:54.964663 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b54d7aff-3cd1-4813-9cbb-e30f399184e9 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] 10.222.0.52 "GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918" status: 200 len: 1315 microversion: 2.1 time: 0.174608 Nov 24 03:12:54.965239 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 497/1022] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:54 2021] GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:55.486058 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-72429d3d-4e27-49d0-8a58-330772472fff tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1354169105", "imageRef": "04860a4a-47c3-4532-865d-be6c9c493af7", "flavorRef": "452", "networks": [{"uuid": "4084daa0-1103-4a60-b744-f9d306495aa3"}]}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:12:55.545786 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.network.neutron [None req-72429d3d-4e27-49d0-8a58-330772472fff tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] validate_networks() for [('4084daa0-1103-4a60-b744-f9d306495aa3', None, None, None, None, None)] {{(pid=116331) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:12:55.931751 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-72429d3d-4e27-49d0-8a58-330772472fff tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Flavor limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:12:55.932634 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-72429d3d-4e27-49d0-8a58-330772472fff tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Image limits 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:12:55.933386 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-72429d3d-4e27-49d0-8a58-330772472fff tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Flavor pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:12:55.933818 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-72429d3d-4e27-49d0-8a58-330772472fff tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Image pref 0:0:0 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:12:55.934262 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.virt.hardware [None req-72429d3d-4e27-49d0-8a58-330772472fff tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116331) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:12:55.950667 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-72429d3d-4e27-49d0-8a58-330772472fff tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:55.951094 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-72429d3d-4e27-49d0-8a58-330772472fff tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:55.951893 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-72429d3d-4e27-49d0-8a58-330772472fff tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:55.952322 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-72429d3d-4e27-49d0-8a58-330772472fff tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:55.970108 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-72429d3d-4e27-49d0-8a58-330772472fff tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Getting quotas for project de048ca1330d41aa8231217a13fe5327. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:12:55.974435 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-72429d3d-4e27-49d0-8a58-330772472fff tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Getting quotas for user 01892d0dcfcd41d0bd1fc73c50f68698 and project de048ca1330d41aa8231217a13fe5327. Resources: {'ram', 'cores', 'instances'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:12:55.981858 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-82b4d33a-ebec-434c-9a51-bb85d62b6757 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:55.982552 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-82b4d33a-ebec-434c-9a51-bb85d62b6757 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] [instance: 07fdfafa-db95-4596-96be-1ec4c766d918] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:55.986741 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-72429d3d-4e27-49d0-8a58-330772472fff tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Going to run 1 instances... {{(pid=116331) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:12:55.989110 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-72429d3d-4e27-49d0-8a58-330772472fff tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: aead3f75-4296-455c-a3af-37933a8ed711] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04860a4a-47c3-4532-865d-be6c9c493af7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116331) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:12:55.989271 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-82b4d33a-ebec-434c-9a51-bb85d62b6757 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:55.989718 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-82b4d33a-ebec-434c-9a51-bb85d62b6757 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:55.990538 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-82b4d33a-ebec-434c-9a51-bb85d62b6757 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:55.990968 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-82b4d33a-ebec-434c-9a51-bb85d62b6757 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:56.037279 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-72429d3d-4e27-49d0-8a58-330772472fff tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555264 Nov 24 03:12:56.038129 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 526/1023] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Nov 24 03:12:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 03:12:56.047947 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5bd36bd9-fb21-461c-ac1f-0168abdaece1 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:56.048551 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-5bd36bd9-fb21-461c-ac1f-0168abdaece1 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: aead3f75-4296-455c-a3af-37933a8ed711] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:56.105341 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5bd36bd9-fb21-461c-ac1f-0168abdaece1 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:56.113010 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-5bd36bd9-fb21-461c-ac1f-0168abdaece1 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711" status: 200 len: 1219 microversion: 2.1 time: 0.068607 Nov 24 03:12:56.113600 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 527/1024] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:56 2021] GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:12:56.129962 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-82b4d33a-ebec-434c-9a51-bb85d62b6757 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adce5d1a239947f682e14646db95a814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9891205dbe2a4c3e8e66cb4d967cba16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:56.137541 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-82b4d33a-ebec-434c-9a51-bb85d62b6757 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] 10.222.0.52 "GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918" status: 200 len: 1315 microversion: 2.1 time: 0.159435 Nov 24 03:12:56.138357 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 498/1025] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:55 2021] GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:57.130485 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0cc67b8f-16b0-466d-9dd3-a47e1ec4bfeb tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:57.131806 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0cc67b8f-16b0-466d-9dd3-a47e1ec4bfeb tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: aead3f75-4296-455c-a3af-37933a8ed711] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:57.139962 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0cc67b8f-16b0-466d-9dd3-a47e1ec4bfeb tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:57.140420 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0cc67b8f-16b0-466d-9dd3-a47e1ec4bfeb tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:57.141221 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0cc67b8f-16b0-466d-9dd3-a47e1ec4bfeb tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:57.141656 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0cc67b8f-16b0-466d-9dd3-a47e1ec4bfeb tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:57.156448 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c70631fd-962b-4713-bfbb-11819a2fbe6f tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:57.157253 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c70631fd-962b-4713-bfbb-11819a2fbe6f tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] [instance: 07fdfafa-db95-4596-96be-1ec4c766d918] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:57.165000 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c70631fd-962b-4713-bfbb-11819a2fbe6f tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:57.165457 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c70631fd-962b-4713-bfbb-11819a2fbe6f tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:57.166284 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c70631fd-962b-4713-bfbb-11819a2fbe6f tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:57.166806 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c70631fd-962b-4713-bfbb-11819a2fbe6f tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:57.204267 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0cc67b8f-16b0-466d-9dd3-a47e1ec4bfeb tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:57.211660 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0cc67b8f-16b0-466d-9dd3-a47e1ec4bfeb tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711" status: 200 len: 1277 microversion: 2.1 time: 0.084809 Nov 24 03:12:57.212582 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 528/1026] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:57 2021] GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711 => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:57.352101 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c70631fd-962b-4713-bfbb-11819a2fbe6f tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adce5d1a239947f682e14646db95a814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9891205dbe2a4c3e8e66cb4d967cba16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:57.359853 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c70631fd-962b-4713-bfbb-11819a2fbe6f tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] 10.222.0.52 "GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918" status: 200 len: 1465 microversion: 2.1 time: 0.208924 Nov 24 03:12:57.360354 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 499/1027] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:57 2021] GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918 => generated 1465 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:57.402532 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-728ab13e-22ff-4caa-9364-ad4443379d7a tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:57.403026 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-728ab13e-22ff-4caa-9364-ad4443379d7a tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] [instance: 07fdfafa-db95-4596-96be-1ec4c766d918] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:57.409162 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-728ab13e-22ff-4caa-9364-ad4443379d7a tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:57.409614 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-728ab13e-22ff-4caa-9364-ad4443379d7a tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:57.410522 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-728ab13e-22ff-4caa-9364-ad4443379d7a tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:57.410955 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-728ab13e-22ff-4caa-9364-ad4443379d7a tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:57.436551 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-728ab13e-22ff-4caa-9364-ad4443379d7a tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] [instance: 07fdfafa-db95-4596-96be-1ec4c766d918] Going to try to terminate instance {{(pid=116331) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:12:57.521317 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-728ab13e-22ff-4caa-9364-ad4443379d7a tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] 10.222.0.52 "DELETE /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918" status: 204 len: 0 microversion: 2.1 time: 0.122238 Nov 24 03:12:57.521983 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 529/1028] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:12:57 2021] DELETE /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:12:57.530340 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c83f0318-e9cd-4e78-87dd-8e1f39e9d5f4 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:57.531044 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c83f0318-e9cd-4e78-87dd-8e1f39e9d5f4 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] [instance: 07fdfafa-db95-4596-96be-1ec4c766d918] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:57.538051 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c83f0318-e9cd-4e78-87dd-8e1f39e9d5f4 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:57.538778 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c83f0318-e9cd-4e78-87dd-8e1f39e9d5f4 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:57.539714 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c83f0318-e9cd-4e78-87dd-8e1f39e9d5f4 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:57.540195 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c83f0318-e9cd-4e78-87dd-8e1f39e9d5f4 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:57.737843 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c83f0318-e9cd-4e78-87dd-8e1f39e9d5f4 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adce5d1a239947f682e14646db95a814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9891205dbe2a4c3e8e66cb4d967cba16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:57.746568 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c83f0318-e9cd-4e78-87dd-8e1f39e9d5f4 tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] 10.222.0.52 "GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918" status: 200 len: 1471 microversion: 2.1 time: 0.219993 Nov 24 03:12:57.755518 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 500/1029] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:57 2021] GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918 => generated 1471 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:58.231886 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-f0c75c10-a516-4960-9309-b779f6cde003 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:58.233348 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-f0c75c10-a516-4960-9309-b779f6cde003 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: aead3f75-4296-455c-a3af-37933a8ed711] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:58.242192 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f0c75c10-a516-4960-9309-b779f6cde003 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:58.242759 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f0c75c10-a516-4960-9309-b779f6cde003 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:58.243821 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f0c75c10-a516-4960-9309-b779f6cde003 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:58.244344 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-f0c75c10-a516-4960-9309-b779f6cde003 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:58.388138 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-f0c75c10-a516-4960-9309-b779f6cde003 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:58.396409 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-f0c75c10-a516-4960-9309-b779f6cde003 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711" status: 200 len: 1319 microversion: 2.1 time: 0.170919 Nov 24 03:12:58.397003 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 530/1030] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:58 2021] GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:12:58.463738 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-08d121f4-fc3a-42bc-a6f2-66d514fce616 req-8893fad7-b8a7-482e-a292-09effa0534b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aead3f75-4296-455c-a3af-37933a8ed711", "tag": "7ee79145-3d10-417c-bbbb-aff24f88441d"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:12:58.466870 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:12:58.466870 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:12:58.475184 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-08d121f4-fc3a-42bc-a6f2-66d514fce616 req-8893fad7-b8a7-482e-a292-09effa0534b0 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:58.475825 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-08d121f4-fc3a-42bc-a6f2-66d514fce616 req-8893fad7-b8a7-482e-a292-09effa0534b0 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:58.489493 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-08d121f4-fc3a-42bc-a6f2-66d514fce616 req-8893fad7-b8a7-482e-a292-09effa0534b0 service nova] Creating event network-changed:7ee79145-3d10-417c-bbbb-aff24f88441d for instance aead3f75-4296-455c-a3af-37933a8ed711 on hv-cinder-81803 Nov 24 03:12:58.494293 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-08d121f4-fc3a-42bc-a6f2-66d514fce616 req-8893fad7-b8a7-482e-a292-09effa0534b0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034347 Nov 24 03:12:58.494928 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 501/1031] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:12:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:12:58.773235 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-4592879e-7177-47d8-9e30-83e53ee0c49e tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:58.773976 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-4592879e-7177-47d8-9e30-83e53ee0c49e tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] [instance: 07fdfafa-db95-4596-96be-1ec4c766d918] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:58.781051 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4592879e-7177-47d8-9e30-83e53ee0c49e tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:58.781504 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4592879e-7177-47d8-9e30-83e53ee0c49e tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:58.782483 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4592879e-7177-47d8-9e30-83e53ee0c49e tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:58.783049 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-4592879e-7177-47d8-9e30-83e53ee0c49e tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:58.941082 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-4592879e-7177-47d8-9e30-83e53ee0c49e tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adce5d1a239947f682e14646db95a814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9891205dbe2a4c3e8e66cb4d967cba16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:58.949716 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-4592879e-7177-47d8-9e30-83e53ee0c49e tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] 10.222.0.52 "GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918" status: 200 len: 1471 microversion: 2.1 time: 0.180359 Nov 24 03:12:58.950513 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 531/1032] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:58 2021] GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918 => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:59.415409 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5301f7d9-4b8d-4d5d-b4aa-a16482d77447 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:59.415839 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5301f7d9-4b8d-4d5d-b4aa-a16482d77447 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: aead3f75-4296-455c-a3af-37933a8ed711] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:59.422830 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5301f7d9-4b8d-4d5d-b4aa-a16482d77447 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:59.423720 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5301f7d9-4b8d-4d5d-b4aa-a16482d77447 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:59.424530 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5301f7d9-4b8d-4d5d-b4aa-a16482d77447 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:59.424966 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5301f7d9-4b8d-4d5d-b4aa-a16482d77447 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:59.463886 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-1222fafb-f1bc-4c57-a71e-b244366f9f19 req-5494b388-6671-4643-985a-4e7aeff2fcc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07fdfafa-db95-4596-96be-1ec4c766d918", "name": "network-vif-deleted", "tag": "c27c89ad-706c-495d-8927-3a0b890861b0"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:12:59.467733 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:12:59.467733 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:12:59.476145 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-1222fafb-f1bc-4c57-a71e-b244366f9f19 req-5494b388-6671-4643-985a-4e7aeff2fcc5 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:59.476953 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-1222fafb-f1bc-4c57-a71e-b244366f9f19 req-5494b388-6671-4643-985a-4e7aeff2fcc5 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:59.490745 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-1222fafb-f1bc-4c57-a71e-b244366f9f19 req-5494b388-6671-4643-985a-4e7aeff2fcc5 service nova] Creating event network-vif-deleted:c27c89ad-706c-495d-8927-3a0b890861b0 for instance 07fdfafa-db95-4596-96be-1ec4c766d918 on hv-cinder-81803 Nov 24 03:12:59.500187 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-1222fafb-f1bc-4c57-a71e-b244366f9f19 req-5494b388-6671-4643-985a-4e7aeff2fcc5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039841 Nov 24 03:12:59.500844 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 532/1033] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:12:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:12:59.682669 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5301f7d9-4b8d-4d5d-b4aa-a16482d77447 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:12:59.690055 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5301f7d9-4b8d-4d5d-b4aa-a16482d77447 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711" status: 200 len: 1319 microversion: 2.1 time: 0.280584 Nov 24 03:12:59.690622 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 502/1034] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:59 2021] GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:12:59.968895 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-596b91d2-e4ce-4345-99de-4fc3834ee4ff tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:12:59.969649 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-596b91d2-e4ce-4345-99de-4fc3834ee4ff tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] [instance: 07fdfafa-db95-4596-96be-1ec4c766d918] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:12:59.976916 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-596b91d2-e4ce-4345-99de-4fc3834ee4ff tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:59.977834 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-596b91d2-e4ce-4345-99de-4fc3834ee4ff tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:59.978826 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-596b91d2-e4ce-4345-99de-4fc3834ee4ff tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:12:59.979241 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-596b91d2-e4ce-4345-99de-4fc3834ee4ff tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:12:59.993229 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-596b91d2-e4ce-4345-99de-4fc3834ee4ff tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] HTTP exception thrown: Instance 07fdfafa-db95-4596-96be-1ec4c766d918 could not be found. Nov 24 03:12:59.993815 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-596b91d2-e4ce-4345-99de-4fc3834ee4ff tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] Returning 404 to user: Instance 07fdfafa-db95-4596-96be-1ec4c766d918 could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:12:59.994921 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-596b91d2-e4ce-4345-99de-4fc3834ee4ff tempest-VolumesNegativeTest-1855512039 tempest-VolumesNegativeTest-1855512039-project] 10.222.0.52 "GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918" status: 404 len: 111 microversion: 2.1 time: 0.031132 Nov 24 03:12:59.996216 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 533/1035] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:12:59 2021] GET /compute/v2.1/servers/07fdfafa-db95-4596-96be-1ec4c766d918 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 03:13:00.706868 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bf0a37bc-5933-40d0-bef8-f8d173bba7e8 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:13:00.707474 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bf0a37bc-5933-40d0-bef8-f8d173bba7e8 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: aead3f75-4296-455c-a3af-37933a8ed711] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:13:00.715189 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bf0a37bc-5933-40d0-bef8-f8d173bba7e8 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:00.715635 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bf0a37bc-5933-40d0-bef8-f8d173bba7e8 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:00.716401 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bf0a37bc-5933-40d0-bef8-f8d173bba7e8 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:00.716826 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bf0a37bc-5933-40d0-bef8-f8d173bba7e8 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:00.851870 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-bf0a37bc-5933-40d0-bef8-f8d173bba7e8 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:13:00.859358 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bf0a37bc-5933-40d0-bef8-f8d173bba7e8 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711" status: 200 len: 1319 microversion: 2.1 time: 0.156362 Nov 24 03:13:00.859940 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 503/1036] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:13:00 2021] GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:13:01.875270 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-473b0ab1-bac2-4eb1-9cfa-075bb466ca84 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:13:01.875979 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-473b0ab1-bac2-4eb1-9cfa-075bb466ca84 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: aead3f75-4296-455c-a3af-37933a8ed711] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:13:01.882431 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-473b0ab1-bac2-4eb1-9cfa-075bb466ca84 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:01.882918 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-473b0ab1-bac2-4eb1-9cfa-075bb466ca84 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:01.883798 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-473b0ab1-bac2-4eb1-9cfa-075bb466ca84 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:01.884334 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-473b0ab1-bac2-4eb1-9cfa-075bb466ca84 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:02.040780 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-473b0ab1-bac2-4eb1-9cfa-075bb466ca84 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:13:02.048660 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-473b0ab1-bac2-4eb1-9cfa-075bb466ca84 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711" status: 200 len: 1319 microversion: 2.1 time: 0.177023 Nov 24 03:13:02.049234 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 534/1037] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:13:01 2021] GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:13:03.065587 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5421ad2b-285a-4b98-a231-0872ce997a7f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:13:03.066107 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5421ad2b-285a-4b98-a231-0872ce997a7f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: aead3f75-4296-455c-a3af-37933a8ed711] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:13:03.072831 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5421ad2b-285a-4b98-a231-0872ce997a7f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:03.073266 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5421ad2b-285a-4b98-a231-0872ce997a7f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:03.074859 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5421ad2b-285a-4b98-a231-0872ce997a7f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:03.075303 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5421ad2b-285a-4b98-a231-0872ce997a7f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:03.229260 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5421ad2b-285a-4b98-a231-0872ce997a7f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:13:03.238278 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5421ad2b-285a-4b98-a231-0872ce997a7f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711" status: 200 len: 1319 microversion: 2.1 time: 0.176255 Nov 24 03:13:03.239005 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 504/1038] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:13:03 2021] GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:13:04.257028 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-1c8a3e04-3052-41bb-b09e-74612bfa6449 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:13:04.257766 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-1c8a3e04-3052-41bb-b09e-74612bfa6449 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: aead3f75-4296-455c-a3af-37933a8ed711] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:13:04.264643 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1c8a3e04-3052-41bb-b09e-74612bfa6449 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:04.265068 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1c8a3e04-3052-41bb-b09e-74612bfa6449 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:04.265868 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1c8a3e04-3052-41bb-b09e-74612bfa6449 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:04.266336 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-1c8a3e04-3052-41bb-b09e-74612bfa6449 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:04.399008 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-1c8a3e04-3052-41bb-b09e-74612bfa6449 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:13:04.406986 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-1c8a3e04-3052-41bb-b09e-74612bfa6449 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711" status: 200 len: 1319 microversion: 2.1 time: 0.153747 Nov 24 03:13:04.407652 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 535/1039] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:13:04 2021] GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:13:04.992356 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-6375d34b-1437-424a-a130-0b8f7b44ce9b req-433b8533-e590-4169-9da5-3536a21cf357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aead3f75-4296-455c-a3af-37933a8ed711", "name": "network-vif-plugged", "status": "completed", "tag": "7ee79145-3d10-417c-bbbb-aff24f88441d"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:13:04.993988 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:13:04.993988 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:13:05.002718 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-6375d34b-1437-424a-a130-0b8f7b44ce9b req-433b8533-e590-4169-9da5-3536a21cf357 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:05.003148 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-6375d34b-1437-424a-a130-0b8f7b44ce9b req-433b8533-e590-4169-9da5-3536a21cf357 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:05.015789 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-6375d34b-1437-424a-a130-0b8f7b44ce9b req-433b8533-e590-4169-9da5-3536a21cf357 service nova] Creating event network-vif-plugged:7ee79145-3d10-417c-bbbb-aff24f88441d for instance aead3f75-4296-455c-a3af-37933a8ed711 on hv-cinder-81803 Nov 24 03:13:05.020788 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-6375d34b-1437-424a-a130-0b8f7b44ce9b req-433b8533-e590-4169-9da5-3536a21cf357 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032302 Nov 24 03:13:05.021588 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 505/1040] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:13:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:13:05.423901 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c86d8f4d-d3ae-46f3-ba93-3c19e0b7e4a2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:13:05.424534 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c86d8f4d-d3ae-46f3-ba93-3c19e0b7e4a2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: aead3f75-4296-455c-a3af-37933a8ed711] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:13:05.431806 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c86d8f4d-d3ae-46f3-ba93-3c19e0b7e4a2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:05.432427 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c86d8f4d-d3ae-46f3-ba93-3c19e0b7e4a2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:05.433496 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c86d8f4d-d3ae-46f3-ba93-3c19e0b7e4a2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:05.434207 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c86d8f4d-d3ae-46f3-ba93-3c19e0b7e4a2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:05.850604 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c86d8f4d-d3ae-46f3-ba93-3c19e0b7e4a2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:13:05.858510 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c86d8f4d-d3ae-46f3-ba93-3c19e0b7e4a2 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711" status: 200 len: 1319 microversion: 2.1 time: 0.438462 Nov 24 03:13:05.859111 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 536/1041] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:13:05 2021] GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711 => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:13:06.876409 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d0eb4690-ab2b-47a7-8113-92e4d14b7c13 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:13:06.877159 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d0eb4690-ab2b-47a7-8113-92e4d14b7c13 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: aead3f75-4296-455c-a3af-37933a8ed711] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:13:06.884695 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d0eb4690-ab2b-47a7-8113-92e4d14b7c13 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:06.885151 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d0eb4690-ab2b-47a7-8113-92e4d14b7c13 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:06.886266 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d0eb4690-ab2b-47a7-8113-92e4d14b7c13 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:06.886944 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d0eb4690-ab2b-47a7-8113-92e4d14b7c13 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:07.029248 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d0eb4690-ab2b-47a7-8113-92e4d14b7c13 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:13:07.040514 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d0eb4690-ab2b-47a7-8113-92e4d14b7c13 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711" status: 200 len: 1507 microversion: 2.1 time: 0.168513 Nov 24 03:13:07.041280 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 506/1042] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:13:06 2021] GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:13:07.057585 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7c160aa0-508a-4b3f-a903-64cab629c628 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c1fc9af-d562-47e6-833a-d824cdff9fcb", "device": "/dev/sdb"}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:13:07.058678 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-7c160aa0-508a-4b3f-a903-64cab629c628 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: aead3f75-4296-455c-a3af-37933a8ed711] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:13:07.065380 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7c160aa0-508a-4b3f-a903-64cab629c628 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:07.065835 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7c160aa0-508a-4b3f-a903-64cab629c628 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:07.066639 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7c160aa0-508a-4b3f-a903-64cab629c628 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:07.067066 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7c160aa0-508a-4b3f-a903-64cab629c628 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:07.331189 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7c160aa0-508a-4b3f-a903-64cab629c628 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "POST /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277223 Nov 24 03:13:07.331845 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 537/1043] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Nov 24 03:13:07 2021] POST /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:13:25.717702 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ae0dca91-4bbd-4803-94e4-98ea48121ff3 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:13:25.718490 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ae0dca91-4bbd-4803-94e4-98ea48121ff3 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: aead3f75-4296-455c-a3af-37933a8ed711] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:13:25.725386 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae0dca91-4bbd-4803-94e4-98ea48121ff3 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:25.725839 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae0dca91-4bbd-4803-94e4-98ea48121ff3 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:25.726728 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae0dca91-4bbd-4803-94e4-98ea48121ff3 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:25.727175 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae0dca91-4bbd-4803-94e4-98ea48121ff3 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:25.819600 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-ae0dca91-4bbd-4803-94e4-98ea48121ff3 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lazy-loading 'services' on Instance uuid aead3f75-4296-455c-a3af-37933a8ed711 {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:13:25.899433 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ae0dca91-4bbd-4803-94e4-98ea48121ff3 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711/os-volume_attachments/1c1fc9af-d562-47e6-833a-d824cdff9fcb" status: 202 len: 0 microversion: 2.1 time: 0.185925 Nov 24 03:13:25.900123 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 507/1044] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Nov 24 03:13:25 2021] DELETE /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711/os-volume_attachments/1c1fc9af-d562-47e6-833a-d824cdff9fcb => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 03:13:27.018845 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-8add2aa7-59d4-4323-9003-8e130208bf88 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:13:27.019528 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-8add2aa7-59d4-4323-9003-8e130208bf88 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: aead3f75-4296-455c-a3af-37933a8ed711] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:13:27.026350 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8add2aa7-59d4-4323-9003-8e130208bf88 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:27.026806 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8add2aa7-59d4-4323-9003-8e130208bf88 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:27.027614 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8add2aa7-59d4-4323-9003-8e130208bf88 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:27.028054 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8add2aa7-59d4-4323-9003-8e130208bf88 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:27.055516 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-8add2aa7-59d4-4323-9003-8e130208bf88 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: aead3f75-4296-455c-a3af-37933a8ed711] Going to try to terminate instance {{(pid=116331) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:13:27.167904 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-8add2aa7-59d4-4323-9003-8e130208bf88 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711" status: 204 len: 0 microversion: 2.1 time: 0.154493 Nov 24 03:13:27.168544 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 538/1045] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:13:27 2021] DELETE /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:13:27.177813 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-20f88529-ce05-48f4-889f-1cfdb4c1a97f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:13:27.178564 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-20f88529-ce05-48f4-889f-1cfdb4c1a97f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: aead3f75-4296-455c-a3af-37933a8ed711] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:13:27.186467 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-20f88529-ce05-48f4-889f-1cfdb4c1a97f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:27.186907 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-20f88529-ce05-48f4-889f-1cfdb4c1a97f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:27.187708 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-20f88529-ce05-48f4-889f-1cfdb4c1a97f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:27.188140 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-20f88529-ce05-48f4-889f-1cfdb4c1a97f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:27.335902 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-20f88529-ce05-48f4-889f-1cfdb4c1a97f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:13:27.345083 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-20f88529-ce05-48f4-889f-1cfdb4c1a97f tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711" status: 200 len: 1513 microversion: 2.1 time: 0.171312 Nov 24 03:13:27.345700 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 508/1046] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:13:27 2021] GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:13:28.363215 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-d5764755-1ee0-4dec-a903-0f33eaf5f3b9 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:13:28.364149 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-d5764755-1ee0-4dec-a903-0f33eaf5f3b9 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: aead3f75-4296-455c-a3af-37933a8ed711] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:13:28.371015 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d5764755-1ee0-4dec-a903-0f33eaf5f3b9 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:28.371503 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d5764755-1ee0-4dec-a903-0f33eaf5f3b9 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:28.372372 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d5764755-1ee0-4dec-a903-0f33eaf5f3b9 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:28.373096 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-d5764755-1ee0-4dec-a903-0f33eaf5f3b9 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:28.533431 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-d5764755-1ee0-4dec-a903-0f33eaf5f3b9 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:13:28.547071 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-d5764755-1ee0-4dec-a903-0f33eaf5f3b9 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711" status: 200 len: 1513 microversion: 2.1 time: 0.187645 Nov 24 03:13:28.548150 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 539/1047] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:13:28 2021] GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711 => generated 1513 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:13:29.434937 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-7aedd9a2-6178-4941-9515-76e111b83875 req-14a48217-0d47-4e2c-86c2-984862d8b914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aead3f75-4296-455c-a3af-37933a8ed711", "name": "network-vif-deleted", "tag": "7ee79145-3d10-417c-bbbb-aff24f88441d"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:13:29.437933 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:13:29.437933 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:13:29.448319 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-7aedd9a2-6178-4941-9515-76e111b83875 req-14a48217-0d47-4e2c-86c2-984862d8b914 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:29.448757 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-7aedd9a2-6178-4941-9515-76e111b83875 req-14a48217-0d47-4e2c-86c2-984862d8b914 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:29.462014 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-7aedd9a2-6178-4941-9515-76e111b83875 req-14a48217-0d47-4e2c-86c2-984862d8b914 service nova] Creating event network-vif-deleted:7ee79145-3d10-417c-bbbb-aff24f88441d for instance aead3f75-4296-455c-a3af-37933a8ed711 on hv-cinder-81803 Nov 24 03:13:29.467926 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-7aedd9a2-6178-4941-9515-76e111b83875 req-14a48217-0d47-4e2c-86c2-984862d8b914 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036751 Nov 24 03:13:29.468558 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 509/1048] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:13:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:13:29.564797 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5beadf60-cad1-4268-bc16-4f67ea4fdabe tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:13:29.565391 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-5beadf60-cad1-4268-bc16-4f67ea4fdabe tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: aead3f75-4296-455c-a3af-37933a8ed711] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:13:29.572099 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5beadf60-cad1-4268-bc16-4f67ea4fdabe tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:29.572551 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5beadf60-cad1-4268-bc16-4f67ea4fdabe tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:29.573462 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5beadf60-cad1-4268-bc16-4f67ea4fdabe tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:29.573796 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5beadf60-cad1-4268-bc16-4f67ea4fdabe tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:29.608887 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5beadf60-cad1-4268-bc16-4f67ea4fdabe tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:29.609422 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5beadf60-cad1-4268-bc16-4f67ea4fdabe tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:29.610118 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.objects.instance [None req-5beadf60-cad1-4268-bc16-4f67ea4fdabe tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lazy-loading 'fault' on Instance uuid aead3f75-4296-455c-a3af-37933a8ed711 {{(pid=116331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:13:29.655616 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5beadf60-cad1-4268-bc16-4f67ea4fdabe tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01892d0dcfcd41d0bd1fc73c50f68698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de048ca1330d41aa8231217a13fe5327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:13:29.663662 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-5beadf60-cad1-4268-bc16-4f67ea4fdabe tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711" status: 200 len: 1309 microversion: 2.1 time: 0.102568 Nov 24 03:13:29.664253 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 540/1049] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:13:29 2021] GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:13:30.685796 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1d184cba-335f-4346-8890-0f3c85519364 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:13:30.687017 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1d184cba-335f-4346-8890-0f3c85519364 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] [instance: aead3f75-4296-455c-a3af-37933a8ed711] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:13:30.698353 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d184cba-335f-4346-8890-0f3c85519364 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:30.699123 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d184cba-335f-4346-8890-0f3c85519364 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:30.700436 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d184cba-335f-4346-8890-0f3c85519364 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:13:30.701153 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d184cba-335f-4346-8890-0f3c85519364 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:13:30.714817 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-1d184cba-335f-4346-8890-0f3c85519364 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] HTTP exception thrown: Instance aead3f75-4296-455c-a3af-37933a8ed711 could not be found. Nov 24 03:13:30.715409 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1d184cba-335f-4346-8890-0f3c85519364 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] Returning 404 to user: Instance aead3f75-4296-455c-a3af-37933a8ed711 could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:13:30.716258 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1d184cba-335f-4346-8890-0f3c85519364 tempest-VolumesSnapshotTestJSON-951450572 tempest-VolumesSnapshotTestJSON-951450572-project] 10.222.0.52 "GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711" status: 404 len: 111 microversion: 2.1 time: 0.037299 Nov 24 03:13:30.716925 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 510/1050] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:13:30 2021] GET /compute/v2.1/servers/aead3f75-4296-455c-a3af-37933a8ed711 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:14:01.536597 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 03:14:01.537211 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: Wed Nov 24 03:14:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 03:14:03.877757 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7fa97522-814a-4ece-83d0-54dbce96da9f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Action: 'create', calling method: .version_select at 0x7f7a2dcea430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-855909436"}} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:14:03.895025 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-7fa97522-814a-4ece-83d0-54dbce96da9f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Getting quotas for project bc916a12ffa6450da0f5411cbeced892. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:14:03.899509 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-7fa97522-814a-4ece-83d0-54dbce96da9f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Getting quotas for user 52b561b6a5dd4b989eea3738020c5601 and project bc916a12ffa6450da0f5411cbeced892. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:14:04.201324 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-7fa97522-814a-4ece-83d0-54dbce96da9f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Getting quotas for project bc916a12ffa6450da0f5411cbeced892. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:14:04.205136 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.quota [None req-7fa97522-814a-4ece-83d0-54dbce96da9f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Getting quotas for user 52b561b6a5dd4b989eea3738020c5601 and project bc916a12ffa6450da0f5411cbeced892. Resources: {'key_pairs'} {{(pid=116331) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:14:04.228368 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7fa97522-814a-4ece-83d0-54dbce96da9f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.515398 Nov 24 03:14:04.229384 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 541/1051] 10.222.0.52 () {60 vars in 1157 bytes} [Wed Nov 24 03:14:03 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:14:20.589076 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1fbd2b79-0bba-4362-b1c5-3065a85cb34e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-269249129", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-855909436", "security_groups": [{"name": "tempest-secgroup-smoke-1331480080"}], "block_device_mapping_v2": [{"uuid": "aab34bc6-10f5-45b3-8c79-60f966e22d2c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "70197494-0aff-43ed-a015-c2969285e5b5"}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:14:20.817548 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-1fbd2b79-0bba-4362-b1c5-3065a85cb34e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] validate_networks() for [('70197494-0aff-43ed-a015-c2969285e5b5', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:14:21.199478 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-1fbd2b79-0bba-4362-b1c5-3065a85cb34e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:14:21.200069 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-1fbd2b79-0bba-4362-b1c5-3065a85cb34e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:14:21.200731 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-1fbd2b79-0bba-4362-b1c5-3065a85cb34e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:14:21.201299 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-1fbd2b79-0bba-4362-b1c5-3065a85cb34e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:14:21.201866 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-1fbd2b79-0bba-4362-b1c5-3065a85cb34e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:14:21.213893 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1fbd2b79-0bba-4362-b1c5-3065a85cb34e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:21.214367 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1fbd2b79-0bba-4362-b1c5-3065a85cb34e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:21.215180 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1fbd2b79-0bba-4362-b1c5-3065a85cb34e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:21.215611 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1fbd2b79-0bba-4362-b1c5-3065a85cb34e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:21.232429 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-1fbd2b79-0bba-4362-b1c5-3065a85cb34e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Getting quotas for project bc916a12ffa6450da0f5411cbeced892. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:14:21.237056 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-1fbd2b79-0bba-4362-b1c5-3065a85cb34e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Getting quotas for user 52b561b6a5dd4b989eea3738020c5601 and project bc916a12ffa6450da0f5411cbeced892. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:14:21.294933 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1fbd2b79-0bba-4362-b1c5-3065a85cb34e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:14:21.297089 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1fbd2b79-0bba-4362-b1c5-3065a85cb34e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aab34bc6-10f5-45b3-8c79-60f966e22d2c',volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:14:21.445541 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1fbd2b79-0bba-4362-b1c5-3065a85cb34e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.860318 Nov 24 03:14:21.446491 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 511/1052] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Nov 24 03:14:20 2021] POST /compute/v2.1/servers => generated 406 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 03:14:21.456799 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2f23f68c-90f8-45eb-b909-2e224cbf3237 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:14:21.457406 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2f23f68c-90f8-45eb-b909-2e224cbf3237 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:14:21.619115 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2f23f68c-90f8-45eb-b909-2e224cbf3237 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:14:21.626055 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2f23f68c-90f8-45eb-b909-2e224cbf3237 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 200 len: 1093 microversion: 2.1 time: 0.173503 Nov 24 03:14:21.626616 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 542/1053] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:14:21 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 1093 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:14:22.644177 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-eb10a0c4-7cd9-40df-a740-ca3f6b1e3b8e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:14:22.644827 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-eb10a0c4-7cd9-40df-a740-ca3f6b1e3b8e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:14:22.651240 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eb10a0c4-7cd9-40df-a740-ca3f6b1e3b8e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:22.651685 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eb10a0c4-7cd9-40df-a740-ca3f6b1e3b8e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:22.652463 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eb10a0c4-7cd9-40df-a740-ca3f6b1e3b8e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:22.652898 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eb10a0c4-7cd9-40df-a740-ca3f6b1e3b8e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:22.729167 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-eb10a0c4-7cd9-40df-a740-ca3f6b1e3b8e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:14:22.736704 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-eb10a0c4-7cd9-40df-a740-ca3f6b1e3b8e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 200 len: 1209 microversion: 2.1 time: 0.096749 Nov 24 03:14:22.737654 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 512/1054] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:14:22 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:14:23.760252 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ac7237f0-098d-4142-9801-a5ac4317e5b5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:14:23.760876 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ac7237f0-098d-4142-9801-a5ac4317e5b5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:14:23.767811 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ac7237f0-098d-4142-9801-a5ac4317e5b5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:23.768271 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ac7237f0-098d-4142-9801-a5ac4317e5b5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:23.769124 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ac7237f0-098d-4142-9801-a5ac4317e5b5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:23.769563 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ac7237f0-098d-4142-9801-a5ac4317e5b5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:23.835293 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-77025fc8-5392-4251-b7cb-ac7ff6520b95 req-5c5db902-015c-455c-a458-d0317c6252b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b3505d-83b9-42cc-970d-f0feda420936", "tag": "1962cd7c-ea68-4b53-a4fe-34ab6a2ebfcf"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:14:23.837189 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:14:23.837189 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:14:23.847842 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-77025fc8-5392-4251-b7cb-ac7ff6520b95 req-5c5db902-015c-455c-a458-d0317c6252b3 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:23.848287 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-77025fc8-5392-4251-b7cb-ac7ff6520b95 req-5c5db902-015c-455c-a458-d0317c6252b3 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:23.861621 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-77025fc8-5392-4251-b7cb-ac7ff6520b95 req-5c5db902-015c-455c-a458-d0317c6252b3 service nova] Creating event network-changed:1962cd7c-ea68-4b53-a4fe-34ab6a2ebfcf for instance 88b3505d-83b9-42cc-970d-f0feda420936 on hv-cinder-81803 Nov 24 03:14:23.867608 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-77025fc8-5392-4251-b7cb-ac7ff6520b95 req-5c5db902-015c-455c-a458-d0317c6252b3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035933 Nov 24 03:14:23.868813 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 513/1055] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:14:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:14:23.929319 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ac7237f0-098d-4142-9801-a5ac4317e5b5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:14:23.937243 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ac7237f0-098d-4142-9801-a5ac4317e5b5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 200 len: 1265 microversion: 2.1 time: 0.181288 Nov 24 03:14:23.937828 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 543/1056] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:14:23 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:14:24.955157 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a478b4fb-d2fe-4a28-9556-d351167a679f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:14:24.955863 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a478b4fb-d2fe-4a28-9556-d351167a679f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:14:24.963202 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a478b4fb-d2fe-4a28-9556-d351167a679f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:24.963654 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a478b4fb-d2fe-4a28-9556-d351167a679f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:24.964455 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a478b4fb-d2fe-4a28-9556-d351167a679f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:24.964899 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a478b4fb-d2fe-4a28-9556-d351167a679f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:25.177761 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a478b4fb-d2fe-4a28-9556-d351167a679f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:14:25.185637 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a478b4fb-d2fe-4a28-9556-d351167a679f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 200 len: 1265 microversion: 2.1 time: 0.234540 Nov 24 03:14:25.186251 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 514/1057] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:14:24 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:14:26.202789 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c7934113-d00a-499a-a5fe-0dc70e042329 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:14:26.203424 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c7934113-d00a-499a-a5fe-0dc70e042329 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:14:26.210363 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c7934113-d00a-499a-a5fe-0dc70e042329 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:26.211020 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c7934113-d00a-499a-a5fe-0dc70e042329 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:26.211815 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c7934113-d00a-499a-a5fe-0dc70e042329 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:26.212258 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c7934113-d00a-499a-a5fe-0dc70e042329 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:26.231613 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 03:14:26.232175 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: Wed Nov 24 03:14:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 03:14:26.361010 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-c7934113-d00a-499a-a5fe-0dc70e042329 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:14:26.370791 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c7934113-d00a-499a-a5fe-0dc70e042329 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 200 len: 1265 microversion: 2.1 time: 0.171728 Nov 24 03:14:26.371377 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 544/1058] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:14:26 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:14:27.391447 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8c6d89df-4849-4507-a5e7-ce70a53a91d5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:14:27.392035 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8c6d89df-4849-4507-a5e7-ce70a53a91d5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:14:27.401298 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8c6d89df-4849-4507-a5e7-ce70a53a91d5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:27.401754 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8c6d89df-4849-4507-a5e7-ce70a53a91d5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:27.402571 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8c6d89df-4849-4507-a5e7-ce70a53a91d5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:27.403008 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8c6d89df-4849-4507-a5e7-ce70a53a91d5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:27.558575 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8c6d89df-4849-4507-a5e7-ce70a53a91d5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:14:27.569572 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8c6d89df-4849-4507-a5e7-ce70a53a91d5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 200 len: 1265 microversion: 2.1 time: 0.184110 Nov 24 03:14:27.570170 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 515/1059] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:14:27 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:14:28.586702 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7eaadd0b-47e6-4dc7-bb81-df633ca733cf tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:14:28.587377 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-7eaadd0b-47e6-4dc7-bb81-df633ca733cf tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:14:28.594148 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7eaadd0b-47e6-4dc7-bb81-df633ca733cf tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:28.594598 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7eaadd0b-47e6-4dc7-bb81-df633ca733cf tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:28.595380 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7eaadd0b-47e6-4dc7-bb81-df633ca733cf tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:28.595805 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7eaadd0b-47e6-4dc7-bb81-df633ca733cf tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:28.754192 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7eaadd0b-47e6-4dc7-bb81-df633ca733cf tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:14:28.765898 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7eaadd0b-47e6-4dc7-bb81-df633ca733cf tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 200 len: 1265 microversion: 2.1 time: 0.182690 Nov 24 03:14:28.766737 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 545/1060] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:14:28 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:14:29.786537 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-66545fbd-10d5-4ae9-b22c-a033c300214b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:14:29.787173 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-66545fbd-10d5-4ae9-b22c-a033c300214b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:14:29.793977 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66545fbd-10d5-4ae9-b22c-a033c300214b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:29.794441 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66545fbd-10d5-4ae9-b22c-a033c300214b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:29.795216 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66545fbd-10d5-4ae9-b22c-a033c300214b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:29.795647 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66545fbd-10d5-4ae9-b22c-a033c300214b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:29.946158 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-66545fbd-10d5-4ae9-b22c-a033c300214b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:14:29.954692 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-66545fbd-10d5-4ae9-b22c-a033c300214b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 200 len: 1265 microversion: 2.1 time: 0.171903 Nov 24 03:14:29.955260 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 516/1061] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:14:29 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:14:30.977265 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5f05868f-743b-45a1-8b6b-8a95f43bac7e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:14:30.978092 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-5f05868f-743b-45a1-8b6b-8a95f43bac7e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:14:30.987181 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5f05868f-743b-45a1-8b6b-8a95f43bac7e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:30.987822 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5f05868f-743b-45a1-8b6b-8a95f43bac7e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:30.988898 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5f05868f-743b-45a1-8b6b-8a95f43bac7e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:30.989479 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5f05868f-743b-45a1-8b6b-8a95f43bac7e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:31.148688 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5f05868f-743b-45a1-8b6b-8a95f43bac7e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:14:31.161585 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-5f05868f-743b-45a1-8b6b-8a95f43bac7e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 200 len: 1265 microversion: 2.1 time: 0.189018 Nov 24 03:14:31.162631 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 546/1062] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:14:30 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:14:32.179620 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7da9a932-dcae-441d-96fc-6ff93c97b73a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:14:32.180262 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7da9a932-dcae-441d-96fc-6ff93c97b73a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:14:32.187019 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7da9a932-dcae-441d-96fc-6ff93c97b73a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:32.187466 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7da9a932-dcae-441d-96fc-6ff93c97b73a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:32.188244 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7da9a932-dcae-441d-96fc-6ff93c97b73a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:32.188671 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7da9a932-dcae-441d-96fc-6ff93c97b73a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:32.324952 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7da9a932-dcae-441d-96fc-6ff93c97b73a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:14:32.332759 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7da9a932-dcae-441d-96fc-6ff93c97b73a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 200 len: 1265 microversion: 2.1 time: 0.156857 Nov 24 03:14:32.333305 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 517/1063] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:14:32 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:14:33.352278 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-31ccc85d-4ccb-4993-8055-2e891667efdc tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:14:33.352898 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-31ccc85d-4ccb-4993-8055-2e891667efdc tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:14:33.360364 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-31ccc85d-4ccb-4993-8055-2e891667efdc tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:33.361005 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-31ccc85d-4ccb-4993-8055-2e891667efdc tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:33.362153 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-31ccc85d-4ccb-4993-8055-2e891667efdc tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:33.362722 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-31ccc85d-4ccb-4993-8055-2e891667efdc tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:33.502944 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-31ccc85d-4ccb-4993-8055-2e891667efdc tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:14:33.510585 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-31ccc85d-4ccb-4993-8055-2e891667efdc tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 200 len: 1265 microversion: 2.1 time: 0.162450 Nov 24 03:14:33.511162 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 547/1064] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:14:33 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:14:34.531732 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-65d167d9-117f-4363-960a-4f4964aa558d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:14:34.532362 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-65d167d9-117f-4363-960a-4f4964aa558d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:14:34.542198 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-65d167d9-117f-4363-960a-4f4964aa558d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:34.542833 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-65d167d9-117f-4363-960a-4f4964aa558d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:34.544032 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-65d167d9-117f-4363-960a-4f4964aa558d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:34.544595 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-65d167d9-117f-4363-960a-4f4964aa558d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:34.680955 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-65d167d9-117f-4363-960a-4f4964aa558d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:14:34.689374 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-65d167d9-117f-4363-960a-4f4964aa558d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 200 len: 1265 microversion: 2.1 time: 0.163582 Nov 24 03:14:34.689955 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 518/1065] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:14:34 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:14:35.572443 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-9ffe2fc0-354b-44d7-9030-d6b402643120 req-41d2c732-0d21-4e52-85bf-4fb9804662d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b3505d-83b9-42cc-970d-f0feda420936", "name": "network-vif-plugged", "status": "completed", "tag": "1962cd7c-ea68-4b53-a4fe-34ab6a2ebfcf"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:14:35.573950 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:14:35.573950 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:14:35.582832 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-9ffe2fc0-354b-44d7-9030-d6b402643120 req-41d2c732-0d21-4e52-85bf-4fb9804662d6 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:35.583314 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-9ffe2fc0-354b-44d7-9030-d6b402643120 req-41d2c732-0d21-4e52-85bf-4fb9804662d6 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:35.596386 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-9ffe2fc0-354b-44d7-9030-d6b402643120 req-41d2c732-0d21-4e52-85bf-4fb9804662d6 service nova] Creating event network-vif-plugged:1962cd7c-ea68-4b53-a4fe-34ab6a2ebfcf for instance 88b3505d-83b9-42cc-970d-f0feda420936 on hv-cinder-81803 Nov 24 03:14:35.602062 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-9ffe2fc0-354b-44d7-9030-d6b402643120 req-41d2c732-0d21-4e52-85bf-4fb9804662d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032639 Nov 24 03:14:35.602357 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 548/1066] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:14:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:14:35.707483 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6ab0348d-8223-4a6f-9ee4-e31a6bf8a31b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:14:35.708088 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6ab0348d-8223-4a6f-9ee4-e31a6bf8a31b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:14:35.715641 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6ab0348d-8223-4a6f-9ee4-e31a6bf8a31b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:35.716232 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6ab0348d-8223-4a6f-9ee4-e31a6bf8a31b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:35.717044 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6ab0348d-8223-4a6f-9ee4-e31a6bf8a31b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:35.717488 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6ab0348d-8223-4a6f-9ee4-e31a6bf8a31b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:35.893880 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6ab0348d-8223-4a6f-9ee4-e31a6bf8a31b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:14:35.901954 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6ab0348d-8223-4a6f-9ee4-e31a6bf8a31b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 200 len: 1265 microversion: 2.1 time: 0.198967 Nov 24 03:14:35.902692 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 519/1067] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:14:35 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:14:36.921122 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-9bd7c96a-b647-4793-a1e6-7a2c8c767a3d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:14:36.922244 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-9bd7c96a-b647-4793-a1e6-7a2c8c767a3d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:14:36.929328 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9bd7c96a-b647-4793-a1e6-7a2c8c767a3d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:36.929784 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9bd7c96a-b647-4793-a1e6-7a2c8c767a3d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:36.930607 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9bd7c96a-b647-4793-a1e6-7a2c8c767a3d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:36.931053 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9bd7c96a-b647-4793-a1e6-7a2c8c767a3d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:37.088758 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-9bd7c96a-b647-4793-a1e6-7a2c8c767a3d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:14:37.098172 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-9bd7c96a-b647-4793-a1e6-7a2c8c767a3d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 200 len: 1450 microversion: 2.1 time: 0.181113 Nov 24 03:14:37.098751 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 549/1068] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:14:36 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 1450 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:14:37.114274 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4a1a6cf8-5a85-4b3e-b789-8f936ac2d232 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:14:37.114873 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4a1a6cf8-5a85-4b3e-b789-8f936ac2d232 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:14:37.121364 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4a1a6cf8-5a85-4b3e-b789-8f936ac2d232 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:37.121809 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4a1a6cf8-5a85-4b3e-b789-8f936ac2d232 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:37.122629 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4a1a6cf8-5a85-4b3e-b789-8f936ac2d232 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:37.123061 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4a1a6cf8-5a85-4b3e-b789-8f936ac2d232 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:37.270112 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4a1a6cf8-5a85-4b3e-b789-8f936ac2d232 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:14:37.280875 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4a1a6cf8-5a85-4b3e-b789-8f936ac2d232 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 200 len: 1450 microversion: 2.1 time: 0.170177 Nov 24 03:14:37.281449 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 520/1069] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:14:37 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 1450 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:14:39.121317 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-e49f26bd-153e-46ea-87a1-c93545ad6c3a req-689d1867-fb01-4523-b33a-4ce6e67bfddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b3505d-83b9-42cc-970d-f0feda420936", "tag": "1962cd7c-ea68-4b53-a4fe-34ab6a2ebfcf"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:14:39.122840 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:14:39.122840 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:14:39.130395 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-e49f26bd-153e-46ea-87a1-c93545ad6c3a req-689d1867-fb01-4523-b33a-4ce6e67bfddf service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:14:39.130831 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-e49f26bd-153e-46ea-87a1-c93545ad6c3a req-689d1867-fb01-4523-b33a-4ce6e67bfddf service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:14:39.142615 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-e49f26bd-153e-46ea-87a1-c93545ad6c3a req-689d1867-fb01-4523-b33a-4ce6e67bfddf service nova] Creating event network-changed:1962cd7c-ea68-4b53-a4fe-34ab6a2ebfcf for instance 88b3505d-83b9-42cc-970d-f0feda420936 on hv-cinder-81803 Nov 24 03:14:39.147667 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-e49f26bd-153e-46ea-87a1-c93545ad6c3a req-689d1867-fb01-4523-b33a-4ce6e67bfddf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088448 Nov 24 03:14:39.148352 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 550/1070] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:14:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:16:31.553596 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e734812d-6a45-4363-86e2-41a58f06cf66 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:31.554301 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e734812d-6a45-4363-86e2-41a58f06cf66 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:31.561565 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e734812d-6a45-4363-86e2-41a58f06cf66 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:31.562087 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e734812d-6a45-4363-86e2-41a58f06cf66 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:31.562930 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e734812d-6a45-4363-86e2-41a58f06cf66 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:31.563367 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e734812d-6a45-4363-86e2-41a58f06cf66 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:31.590451 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e734812d-6a45-4363-86e2-41a58f06cf66 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:16:31.674506 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e734812d-6a45-4363-86e2-41a58f06cf66 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "DELETE /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 204 len: 0 microversion: 2.1 time: 0.125732 Nov 24 03:16:31.675377 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 521/1071] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:16:31 2021] DELETE /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:16:31.690101 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-0665a2c4-5c95-44e6-94b7-346df6f3b0d6 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:31.690911 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-0665a2c4-5c95-44e6-94b7-346df6f3b0d6 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:31.700826 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0665a2c4-5c95-44e6-94b7-346df6f3b0d6 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:31.701457 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0665a2c4-5c95-44e6-94b7-346df6f3b0d6 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:31.702730 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0665a2c4-5c95-44e6-94b7-346df6f3b0d6 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:31.703408 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-0665a2c4-5c95-44e6-94b7-346df6f3b0d6 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:31.847953 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-0665a2c4-5c95-44e6-94b7-346df6f3b0d6 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:16:31.855533 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-0665a2c4-5c95-44e6-94b7-346df6f3b0d6 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 200 len: 1574 microversion: 2.1 time: 0.174470 Nov 24 03:16:31.856100 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 551/1072] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:16:31 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:16:32.874647 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2f8c6c14-7d61-4f15-8ed4-a90a66aa01cf tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:32.875324 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2f8c6c14-7d61-4f15-8ed4-a90a66aa01cf tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:32.882524 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2f8c6c14-7d61-4f15-8ed4-a90a66aa01cf tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:32.883018 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2f8c6c14-7d61-4f15-8ed4-a90a66aa01cf tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:32.883783 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2f8c6c14-7d61-4f15-8ed4-a90a66aa01cf tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:32.884220 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2f8c6c14-7d61-4f15-8ed4-a90a66aa01cf tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:33.358300 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2f8c6c14-7d61-4f15-8ed4-a90a66aa01cf tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:16:33.367446 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2f8c6c14-7d61-4f15-8ed4-a90a66aa01cf tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 200 len: 1574 microversion: 2.1 time: 0.497383 Nov 24 03:16:33.368143 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 522/1073] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:16:32 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 1574 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:16:34.175517 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-2c920400-db71-4a9b-b389-d893500ebbca req-6db0452a-1591-472a-bf95-e3d52ad8f5bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b3505d-83b9-42cc-970d-f0feda420936", "name": "network-vif-deleted", "tag": "1962cd7c-ea68-4b53-a4fe-34ab6a2ebfcf"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:16:34.176444 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:16:34.176444 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:16:34.184213 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-2c920400-db71-4a9b-b389-d893500ebbca req-6db0452a-1591-472a-bf95-e3d52ad8f5bb service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:34.184665 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-2c920400-db71-4a9b-b389-d893500ebbca req-6db0452a-1591-472a-bf95-e3d52ad8f5bb service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:34.199713 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-2c920400-db71-4a9b-b389-d893500ebbca req-6db0452a-1591-472a-bf95-e3d52ad8f5bb service nova] Creating event network-vif-deleted:1962cd7c-ea68-4b53-a4fe-34ab6a2ebfcf for instance 88b3505d-83b9-42cc-970d-f0feda420936 on hv-cinder-81803 Nov 24 03:16:34.205053 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-2c920400-db71-4a9b-b389-d893500ebbca req-6db0452a-1591-472a-bf95-e3d52ad8f5bb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033787 Nov 24 03:16:34.205668 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 552/1074] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:16:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:16:34.384672 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-273bcdd6-e641-46da-ada3-359d323b38fa tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:34.385353 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-273bcdd6-e641-46da-ada3-359d323b38fa tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:34.392402 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-273bcdd6-e641-46da-ada3-359d323b38fa tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:34.392840 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-273bcdd6-e641-46da-ada3-359d323b38fa tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:34.393643 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-273bcdd6-e641-46da-ada3-359d323b38fa tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:34.394153 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-273bcdd6-e641-46da-ada3-359d323b38fa tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:34.456143 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-273bcdd6-e641-46da-ada3-359d323b38fa tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:16:34.465085 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-273bcdd6-e641-46da-ada3-359d323b38fa tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 200 len: 1224 microversion: 2.1 time: 0.083732 Nov 24 03:16:34.465715 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 523/1075] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:16:34 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:16:35.482923 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-a35cb7fb-5d9e-4e81-b619-17d6181818b9 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:35.483643 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-a35cb7fb-5d9e-4e81-b619-17d6181818b9 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:35.490374 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a35cb7fb-5d9e-4e81-b619-17d6181818b9 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:35.490824 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a35cb7fb-5d9e-4e81-b619-17d6181818b9 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:35.491602 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a35cb7fb-5d9e-4e81-b619-17d6181818b9 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:35.492034 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-a35cb7fb-5d9e-4e81-b619-17d6181818b9 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:35.505843 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-a35cb7fb-5d9e-4e81-b619-17d6181818b9 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] HTTP exception thrown: Instance 88b3505d-83b9-42cc-970d-f0feda420936 could not be found. Nov 24 03:16:35.506469 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-a35cb7fb-5d9e-4e81-b619-17d6181818b9 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Returning 404 to user: Instance 88b3505d-83b9-42cc-970d-f0feda420936 could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:16:35.507291 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-a35cb7fb-5d9e-4e81-b619-17d6181818b9 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 404 len: 111 microversion: 2.1 time: 0.029121 Nov 24 03:16:35.507843 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 553/1076] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:16:35 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:16:35.589237 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9630eec6-ca63-488c-9290-0cf5b6757eef tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-323007806", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-855909436", "security_groups": [{"name": "tempest-secgroup-smoke-1331480080"}], "block_device_mapping_v2": [{"uuid": "aab34bc6-10f5-45b3-8c79-60f966e22d2c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "70197494-0aff-43ed-a015-c2969285e5b5"}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:16:35.711849 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-9630eec6-ca63-488c-9290-0cf5b6757eef tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] validate_networks() for [('70197494-0aff-43ed-a015-c2969285e5b5', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:16:36.097346 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-9630eec6-ca63-488c-9290-0cf5b6757eef tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:16:36.097794 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-9630eec6-ca63-488c-9290-0cf5b6757eef tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:16:36.098372 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-9630eec6-ca63-488c-9290-0cf5b6757eef tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:16:36.098778 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-9630eec6-ca63-488c-9290-0cf5b6757eef tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:16:36.099183 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-9630eec6-ca63-488c-9290-0cf5b6757eef tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:16:36.109194 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9630eec6-ca63-488c-9290-0cf5b6757eef tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:36.109646 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9630eec6-ca63-488c-9290-0cf5b6757eef tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:36.110476 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9630eec6-ca63-488c-9290-0cf5b6757eef tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:36.110909 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9630eec6-ca63-488c-9290-0cf5b6757eef tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:36.127473 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-9630eec6-ca63-488c-9290-0cf5b6757eef tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Getting quotas for project bc916a12ffa6450da0f5411cbeced892. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:16:36.131611 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-9630eec6-ca63-488c-9290-0cf5b6757eef tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Getting quotas for user 52b561b6a5dd4b989eea3738020c5601 and project bc916a12ffa6450da0f5411cbeced892. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:16:36.197014 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9630eec6-ca63-488c-9290-0cf5b6757eef tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:16:36.199259 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9630eec6-ca63-488c-9290-0cf5b6757eef tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aab34bc6-10f5-45b3-8c79-60f966e22d2c',volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:16:36.328240 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9630eec6-ca63-488c-9290-0cf5b6757eef tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [eae728e1-49ae-4c7b-811b-4c239d9c9036] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 24 03:16:37.346048 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO oslo.messaging._drivers.impl_rabbit [None req-9630eec6-ca63-488c-9290-0cf5b6757eef tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [eae728e1-49ae-4c7b-811b-4c239d9c9036] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56436. Nov 24 03:16:37.350793 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9630eec6-ca63-488c-9290-0cf5b6757eef tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.768059 Nov 24 03:16:37.351447 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 524/1077] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Nov 24 03:16:35 2021] POST /compute/v2.1/servers => generated 406 bytes in 1770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 03:16:37.362144 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-9741536b-6f74-43d8-8d5f-a6cad85a16ce tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:37.362976 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-9741536b-6f74-43d8-8d5f-a6cad85a16ce tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:37.419510 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-9741536b-6f74-43d8-8d5f-a6cad85a16ce tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:16:37.426448 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-9741536b-6f74-43d8-8d5f-a6cad85a16ce tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 200 len: 1093 microversion: 2.1 time: 0.068554 Nov 24 03:16:37.426998 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 554/1078] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:16:37 2021] GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:16:38.445549 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-32980070-911f-4107-8b45-fb65546b1ae3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:38.446249 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-32980070-911f-4107-8b45-fb65546b1ae3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:38.453001 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-32980070-911f-4107-8b45-fb65546b1ae3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:38.453485 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-32980070-911f-4107-8b45-fb65546b1ae3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:38.454323 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-32980070-911f-4107-8b45-fb65546b1ae3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:38.454756 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-32980070-911f-4107-8b45-fb65546b1ae3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:38.542162 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-32980070-911f-4107-8b45-fb65546b1ae3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:16:38.551057 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-32980070-911f-4107-8b45-fb65546b1ae3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 200 len: 1199 microversion: 2.1 time: 0.109828 Nov 24 03:16:38.551964 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 525/1079] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:16:38 2021] GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 1199 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:16:39.569710 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-cb008d5a-3278-4164-8382-266888384212 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:39.570367 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-cb008d5a-3278-4164-8382-266888384212 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:39.578409 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb008d5a-3278-4164-8382-266888384212 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:39.578945 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb008d5a-3278-4164-8382-266888384212 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:39.579808 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb008d5a-3278-4164-8382-266888384212 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:39.580342 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb008d5a-3278-4164-8382-266888384212 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:39.741608 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-cb008d5a-3278-4164-8382-266888384212 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:16:39.750343 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-cb008d5a-3278-4164-8382-266888384212 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 200 len: 1265 microversion: 2.1 time: 0.184818 Nov 24 03:16:39.751042 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 555/1080] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:16:39 2021] GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:16:39.892846 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-a7a22905-963f-4bd2-b9d5-0f5393fe031d req-d6e9375c-7885-4849-a1c8-ea5c7c399508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67c4d17c-c67b-430a-8016-ecac413d507b", "tag": "f1dc8eb1-f99a-4e83-9f9b-91c639f8b9cf"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:16:39.894664 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:16:39.894664 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:16:39.905230 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-a7a22905-963f-4bd2-b9d5-0f5393fe031d req-d6e9375c-7885-4849-a1c8-ea5c7c399508 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:39.906541 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-a7a22905-963f-4bd2-b9d5-0f5393fe031d req-d6e9375c-7885-4849-a1c8-ea5c7c399508 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:39.921734 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-a7a22905-963f-4bd2-b9d5-0f5393fe031d req-d6e9375c-7885-4849-a1c8-ea5c7c399508 service nova] Creating event network-changed:f1dc8eb1-f99a-4e83-9f9b-91c639f8b9cf for instance 67c4d17c-c67b-430a-8016-ecac413d507b on hv-cinder-81803 Nov 24 03:16:39.927976 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-a7a22905-963f-4bd2-b9d5-0f5393fe031d req-d6e9375c-7885-4849-a1c8-ea5c7c399508 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038726 Nov 24 03:16:39.929320 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 526/1081] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:16:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:16:40.770791 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-282ade7a-75d7-4906-820b-ac70fc8eaadd tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:40.771360 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-282ade7a-75d7-4906-820b-ac70fc8eaadd tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:40.780396 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-282ade7a-75d7-4906-820b-ac70fc8eaadd tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:40.780844 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-282ade7a-75d7-4906-820b-ac70fc8eaadd tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:40.781641 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-282ade7a-75d7-4906-820b-ac70fc8eaadd tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:40.782105 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-282ade7a-75d7-4906-820b-ac70fc8eaadd tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:40.926988 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-282ade7a-75d7-4906-820b-ac70fc8eaadd tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:16:40.937418 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-282ade7a-75d7-4906-820b-ac70fc8eaadd tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 200 len: 1265 microversion: 2.1 time: 0.172061 Nov 24 03:16:40.938024 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 556/1082] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:16:40 2021] GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:16:41.957498 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f582a8a0-cb02-4bb4-bd51-ad6876a7659a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:41.958122 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f582a8a0-cb02-4bb4-bd51-ad6876a7659a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:41.967981 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f582a8a0-cb02-4bb4-bd51-ad6876a7659a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:41.968583 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f582a8a0-cb02-4bb4-bd51-ad6876a7659a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:41.969693 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f582a8a0-cb02-4bb4-bd51-ad6876a7659a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:41.970153 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f582a8a0-cb02-4bb4-bd51-ad6876a7659a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:42.119943 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f582a8a0-cb02-4bb4-bd51-ad6876a7659a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:16:42.128038 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f582a8a0-cb02-4bb4-bd51-ad6876a7659a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 200 len: 1265 microversion: 2.1 time: 0.176695 Nov 24 03:16:42.128613 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 527/1083] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:16:41 2021] GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:16:43.148397 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5d28c397-02ee-4835-91a3-8ffc6b02831c tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:43.149057 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-5d28c397-02ee-4835-91a3-8ffc6b02831c tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:43.157195 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5d28c397-02ee-4835-91a3-8ffc6b02831c tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:43.157653 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5d28c397-02ee-4835-91a3-8ffc6b02831c tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:43.158464 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5d28c397-02ee-4835-91a3-8ffc6b02831c tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:43.158898 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5d28c397-02ee-4835-91a3-8ffc6b02831c tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:43.294160 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5d28c397-02ee-4835-91a3-8ffc6b02831c tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:16:43.302404 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-5d28c397-02ee-4835-91a3-8ffc6b02831c tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 200 len: 1265 microversion: 2.1 time: 0.159819 Nov 24 03:16:43.302990 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 557/1084] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:16:43 2021] GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:16:44.322089 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f7442fdb-2601-422e-a0b5-53c5d4e6b170 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:44.322705 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f7442fdb-2601-422e-a0b5-53c5d4e6b170 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:44.330545 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f7442fdb-2601-422e-a0b5-53c5d4e6b170 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:44.330993 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f7442fdb-2601-422e-a0b5-53c5d4e6b170 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:44.331749 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f7442fdb-2601-422e-a0b5-53c5d4e6b170 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:44.332212 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f7442fdb-2601-422e-a0b5-53c5d4e6b170 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:44.478068 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f7442fdb-2601-422e-a0b5-53c5d4e6b170 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:16:44.490614 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f7442fdb-2601-422e-a0b5-53c5d4e6b170 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 200 len: 1265 microversion: 2.1 time: 0.173718 Nov 24 03:16:44.491375 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 528/1085] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:16:44 2021] GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:16:45.510619 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-dbe2e586-fd7a-40e6-8d6e-a8d76c0b71b3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:45.511157 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-dbe2e586-fd7a-40e6-8d6e-a8d76c0b71b3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:45.518675 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-dbe2e586-fd7a-40e6-8d6e-a8d76c0b71b3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:45.519127 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-dbe2e586-fd7a-40e6-8d6e-a8d76c0b71b3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:45.519917 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-dbe2e586-fd7a-40e6-8d6e-a8d76c0b71b3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:45.520353 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-dbe2e586-fd7a-40e6-8d6e-a8d76c0b71b3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:45.668398 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-dbe2e586-fd7a-40e6-8d6e-a8d76c0b71b3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:16:45.676424 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-dbe2e586-fd7a-40e6-8d6e-a8d76c0b71b3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 200 len: 1265 microversion: 2.1 time: 0.169600 Nov 24 03:16:45.676986 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 558/1086] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:16:45 2021] GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:16:46.693544 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-31075569-a2b8-4a14-9e00-995a5a48bc96 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:46.694187 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-31075569-a2b8-4a14-9e00-995a5a48bc96 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:46.700731 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-31075569-a2b8-4a14-9e00-995a5a48bc96 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:46.701510 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-31075569-a2b8-4a14-9e00-995a5a48bc96 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:46.702384 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-31075569-a2b8-4a14-9e00-995a5a48bc96 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:46.702824 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-31075569-a2b8-4a14-9e00-995a5a48bc96 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:46.846318 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-31075569-a2b8-4a14-9e00-995a5a48bc96 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:16:46.854538 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-31075569-a2b8-4a14-9e00-995a5a48bc96 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 200 len: 1265 microversion: 2.1 time: 0.164800 Nov 24 03:16:46.855129 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 529/1087] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:16:46 2021] GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:16:47.871836 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-21c39403-f8d7-448e-8c34-ff263b1789ee tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:47.872578 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-21c39403-f8d7-448e-8c34-ff263b1789ee tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:47.879441 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-21c39403-f8d7-448e-8c34-ff263b1789ee tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:47.879914 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-21c39403-f8d7-448e-8c34-ff263b1789ee tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:47.880698 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-21c39403-f8d7-448e-8c34-ff263b1789ee tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:47.881126 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-21c39403-f8d7-448e-8c34-ff263b1789ee tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:48.024757 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-21c39403-f8d7-448e-8c34-ff263b1789ee tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:16:48.033307 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-21c39403-f8d7-448e-8c34-ff263b1789ee tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 200 len: 1265 microversion: 2.1 time: 0.165220 Nov 24 03:16:48.033944 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 559/1088] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:16:47 2021] GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:16:49.051016 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-cc788db5-050d-407d-881d-e4a7525def6a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:49.051640 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-cc788db5-050d-407d-881d-e4a7525def6a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:49.058420 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cc788db5-050d-407d-881d-e4a7525def6a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:49.058869 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cc788db5-050d-407d-881d-e4a7525def6a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:49.059646 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cc788db5-050d-407d-881d-e4a7525def6a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:49.060115 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cc788db5-050d-407d-881d-e4a7525def6a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:49.202634 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-cc788db5-050d-407d-881d-e4a7525def6a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:16:49.210431 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-cc788db5-050d-407d-881d-e4a7525def6a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 200 len: 1265 microversion: 2.1 time: 0.163338 Nov 24 03:16:49.211006 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 530/1089] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:16:49 2021] GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:16:50.230105 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-ec7a0897-dd64-4600-8b60-6fae165803b5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:50.230714 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-ec7a0897-dd64-4600-8b60-6fae165803b5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:50.237521 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ec7a0897-dd64-4600-8b60-6fae165803b5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:50.237991 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ec7a0897-dd64-4600-8b60-6fae165803b5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:50.238754 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ec7a0897-dd64-4600-8b60-6fae165803b5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:50.239199 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-ec7a0897-dd64-4600-8b60-6fae165803b5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:50.333610 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-4aec1a83-81e3-4aa2-b216-dfe937c515cc req-e07283f2-91ff-4dec-96f0-c6ce22582849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67c4d17c-c67b-430a-8016-ecac413d507b", "name": "network-vif-plugged", "status": "completed", "tag": "f1dc8eb1-f99a-4e83-9f9b-91c639f8b9cf"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:16:50.335153 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:16:50.335153 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:16:50.342338 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-4aec1a83-81e3-4aa2-b216-dfe937c515cc req-e07283f2-91ff-4dec-96f0-c6ce22582849 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:50.342781 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-4aec1a83-81e3-4aa2-b216-dfe937c515cc req-e07283f2-91ff-4dec-96f0-c6ce22582849 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:50.353817 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-4aec1a83-81e3-4aa2-b216-dfe937c515cc req-e07283f2-91ff-4dec-96f0-c6ce22582849 service nova] Creating event network-vif-plugged:f1dc8eb1-f99a-4e83-9f9b-91c639f8b9cf for instance 67c4d17c-c67b-430a-8016-ecac413d507b on hv-cinder-81803 Nov 24 03:16:50.359252 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-4aec1a83-81e3-4aa2-b216-dfe937c515cc req-e07283f2-91ff-4dec-96f0-c6ce22582849 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103540 Nov 24 03:16:50.359915 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 531/1090] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:16:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:16:50.383972 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-ec7a0897-dd64-4600-8b60-6fae165803b5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:16:50.392322 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-ec7a0897-dd64-4600-8b60-6fae165803b5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 200 len: 1265 microversion: 2.1 time: 0.165881 Nov 24 03:16:50.392896 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 560/1091] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:16:50 2021] GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:16:51.410336 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-56d7de1c-0ea6-46d6-bffc-8ebbb1998418 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:51.411034 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-56d7de1c-0ea6-46d6-bffc-8ebbb1998418 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:51.417842 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-56d7de1c-0ea6-46d6-bffc-8ebbb1998418 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:51.418313 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-56d7de1c-0ea6-46d6-bffc-8ebbb1998418 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:51.419098 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-56d7de1c-0ea6-46d6-bffc-8ebbb1998418 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:51.419720 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-56d7de1c-0ea6-46d6-bffc-8ebbb1998418 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:51.568092 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-56d7de1c-0ea6-46d6-bffc-8ebbb1998418 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:16:51.575917 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-56d7de1c-0ea6-46d6-bffc-8ebbb1998418 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 200 len: 1265 microversion: 2.1 time: 0.170039 Nov 24 03:16:51.577109 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 532/1092] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:16:51 2021] GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:16:52.593867 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7c61c4f4-c170-4317-b788-9e19e5ef5f20 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:52.594446 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-7c61c4f4-c170-4317-b788-9e19e5ef5f20 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:52.601766 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7c61c4f4-c170-4317-b788-9e19e5ef5f20 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:52.602248 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7c61c4f4-c170-4317-b788-9e19e5ef5f20 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:52.603032 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7c61c4f4-c170-4317-b788-9e19e5ef5f20 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:52.603472 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-7c61c4f4-c170-4317-b788-9e19e5ef5f20 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:52.745450 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7c61c4f4-c170-4317-b788-9e19e5ef5f20 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:16:52.755956 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7c61c4f4-c170-4317-b788-9e19e5ef5f20 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 200 len: 1451 microversion: 2.1 time: 0.165898 Nov 24 03:16:52.756545 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 561/1093] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:16:52 2021] GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 1451 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:16:52.772767 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c4808ada-0431-46c5-aacd-83d7bb7968b1 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:16:52.773367 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c4808ada-0431-46c5-aacd-83d7bb7968b1 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:16:52.781833 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4808ada-0431-46c5-aacd-83d7bb7968b1 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:52.782492 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4808ada-0431-46c5-aacd-83d7bb7968b1 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:52.783732 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4808ada-0431-46c5-aacd-83d7bb7968b1 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:52.784159 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4808ada-0431-46c5-aacd-83d7bb7968b1 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:52.926793 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c4808ada-0431-46c5-aacd-83d7bb7968b1 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:16:52.934286 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c4808ada-0431-46c5-aacd-83d7bb7968b1 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 200 len: 1451 microversion: 2.1 time: 0.165165 Nov 24 03:16:52.934862 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 533/1094] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:16:52 2021] GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:16:55.028699 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-9e27872d-7eb2-4357-824e-4a3d884968e1 req-35ee9a94-9a09-4c1b-ad67-cd8231894736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67c4d17c-c67b-430a-8016-ecac413d507b", "tag": "f1dc8eb1-f99a-4e83-9f9b-91c639f8b9cf"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:16:55.030278 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:16:55.030278 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:16:55.038061 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-9e27872d-7eb2-4357-824e-4a3d884968e1 req-35ee9a94-9a09-4c1b-ad67-cd8231894736 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:16:55.038501 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-9e27872d-7eb2-4357-824e-4a3d884968e1 req-35ee9a94-9a09-4c1b-ad67-cd8231894736 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:16:55.049896 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-9e27872d-7eb2-4357-824e-4a3d884968e1 req-35ee9a94-9a09-4c1b-ad67-cd8231894736 service nova] Creating event network-changed:f1dc8eb1-f99a-4e83-9f9b-91c639f8b9cf for instance 67c4d17c-c67b-430a-8016-ecac413d507b on hv-cinder-81803 Nov 24 03:16:55.055924 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-9e27872d-7eb2-4357-824e-4a3d884968e1 req-35ee9a94-9a09-4c1b-ad67-cd8231894736 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030638 Nov 24 03:16:55.056838 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 562/1095] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:16:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:17:21.556959 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 03:17:21.557777 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: Wed Nov 24 03:17:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 03:17:46.251319 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 03:17:46.251820 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: Wed Nov 24 03:17:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 03:18:32.710270 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8d1f90ac-9611-494e-9740-2ca36c55f895 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-530425276", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-855909436", "security_groups": [{"name": "tempest-secgroup-smoke-1331480080"}], "block_device_mapping_v2": [{"uuid": "9694840d-d492-4a6a-8aa9-20b39e6a8c18", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "70197494-0aff-43ed-a015-c2969285e5b5"}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:18:32.835381 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-8d1f90ac-9611-494e-9740-2ca36c55f895 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] validate_networks() for [('70197494-0aff-43ed-a015-c2969285e5b5', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 03:18:33.325805 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-8d1f90ac-9611-494e-9740-2ca36c55f895 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 03:18:33.326263 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-8d1f90ac-9611-494e-9740-2ca36c55f895 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 03:18:33.326733 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-8d1f90ac-9611-494e-9740-2ca36c55f895 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 03:18:33.327133 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-8d1f90ac-9611-494e-9740-2ca36c55f895 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 03:18:33.327534 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-8d1f90ac-9611-494e-9740-2ca36c55f895 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 03:18:33.339627 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8d1f90ac-9611-494e-9740-2ca36c55f895 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:33.340720 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8d1f90ac-9611-494e-9740-2ca36c55f895 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:33.342042 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8d1f90ac-9611-494e-9740-2ca36c55f895 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:33.342654 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8d1f90ac-9611-494e-9740-2ca36c55f895 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:33.364152 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-8d1f90ac-9611-494e-9740-2ca36c55f895 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Getting quotas for project bc916a12ffa6450da0f5411cbeced892. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 03:18:33.368764 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-8d1f90ac-9611-494e-9740-2ca36c55f895 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Getting quotas for user 52b561b6a5dd4b989eea3738020c5601 and project bc916a12ffa6450da0f5411cbeced892. Resources: {'ram', 'cores', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 03:18:33.440143 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8d1f90ac-9611-494e-9740-2ca36c55f895 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 03:18:33.443655 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8d1f90ac-9611-494e-9740-2ca36c55f895 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9694840d-d492-4a6a-8aa9-20b39e6a8c18',volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 03:18:33.590971 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8d1f90ac-9611-494e-9740-2ca36c55f895 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.885057 Nov 24 03:18:33.591610 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 534/1096] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Nov 24 03:18:32 2021] POST /compute/v2.1/servers => generated 406 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 03:18:33.602247 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: ERROR oslo.messaging._drivers.impl_rabbit [-] [537a67b2-eb68-4b56-a3fa-526bf04c83ab] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 24 03:18:33.606335 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-7674a5ba-8f08-47e9-8282-234acadf1867 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:18:33.607129 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-7674a5ba-8f08-47e9-8282-234acadf1867 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:18:33.663080 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-7674a5ba-8f08-47e9-8282-234acadf1867 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:18:33.671016 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-7674a5ba-8f08-47e9-8282-234acadf1867 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 200 len: 1093 microversion: 2.1 time: 0.070684 Nov 24 03:18:33.671977 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 563/1097] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:18:33 2021] GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:18:34.687743 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3c98383e-788c-4023-a092-69a0a3867e50 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:18:34.688325 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3c98383e-788c-4023-a092-69a0a3867e50 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:18:34.695833 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c98383e-788c-4023-a092-69a0a3867e50 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:34.696381 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c98383e-788c-4023-a092-69a0a3867e50 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:34.697323 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c98383e-788c-4023-a092-69a0a3867e50 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:34.697766 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c98383e-788c-4023-a092-69a0a3867e50 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:34.786206 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3c98383e-788c-4023-a092-69a0a3867e50 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:18:34.793698 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3c98383e-788c-4023-a092-69a0a3867e50 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 200 len: 1209 microversion: 2.1 time: 0.109986 Nov 24 03:18:34.794302 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 535/1098] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:18:34 2021] GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 1209 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:18:35.812889 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-5007dc1c-0ab4-4e37-8fd1-655cd63a534f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:18:35.813760 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-5007dc1c-0ab4-4e37-8fd1-655cd63a534f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:18:35.832821 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5007dc1c-0ab4-4e37-8fd1-655cd63a534f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:35.833586 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5007dc1c-0ab4-4e37-8fd1-655cd63a534f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:35.834433 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5007dc1c-0ab4-4e37-8fd1-655cd63a534f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:35.834874 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-5007dc1c-0ab4-4e37-8fd1-655cd63a534f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:35.852353 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO oslo.messaging._drivers.impl_rabbit [-] [537a67b2-eb68-4b56-a3fa-526bf04c83ab] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56590. Nov 24 03:18:35.951590 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-996ce22b-5fca-4cb2-8795-0983f8e56702 req-4291f15b-bfab-4051-a473-1c3a2cafe2da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d3be288-cb78-479a-b00a-eade919da2e8", "tag": "3b0c78e0-aaa4-4182-9969-0e3ee5c921d5"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:18:35.954020 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:18:35.954020 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:18:35.969492 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-996ce22b-5fca-4cb2-8795-0983f8e56702 req-4291f15b-bfab-4051-a473-1c3a2cafe2da service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:35.970318 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-996ce22b-5fca-4cb2-8795-0983f8e56702 req-4291f15b-bfab-4051-a473-1c3a2cafe2da service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:35.984554 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-996ce22b-5fca-4cb2-8795-0983f8e56702 req-4291f15b-bfab-4051-a473-1c3a2cafe2da service nova] Creating event network-changed:3b0c78e0-aaa4-4182-9969-0e3ee5c921d5 for instance 0d3be288-cb78-479a-b00a-eade919da2e8 on hv-cinder-81803 Nov 24 03:18:35.990977 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-996ce22b-5fca-4cb2-8795-0983f8e56702 req-4291f15b-bfab-4051-a473-1c3a2cafe2da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042957 Nov 24 03:18:35.991624 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 536/1099] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:18:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 03:18:36.007506 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-5007dc1c-0ab4-4e37-8fd1-655cd63a534f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:18:36.016879 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-5007dc1c-0ab4-4e37-8fd1-655cd63a534f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 200 len: 1265 microversion: 2.1 time: 0.208081 Nov 24 03:18:36.017741 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 564/1100] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:18:35 2021] GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:18:37.037342 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7dde49d8-59a4-4ea4-87b9-e8c2d9ad3d2f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:18:37.038074 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7dde49d8-59a4-4ea4-87b9-e8c2d9ad3d2f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:18:37.045122 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7dde49d8-59a4-4ea4-87b9-e8c2d9ad3d2f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:37.045664 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7dde49d8-59a4-4ea4-87b9-e8c2d9ad3d2f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:37.046530 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7dde49d8-59a4-4ea4-87b9-e8c2d9ad3d2f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:37.046962 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7dde49d8-59a4-4ea4-87b9-e8c2d9ad3d2f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:37.209958 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7dde49d8-59a4-4ea4-87b9-e8c2d9ad3d2f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:18:37.217929 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7dde49d8-59a4-4ea4-87b9-e8c2d9ad3d2f tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 200 len: 1265 microversion: 2.1 time: 0.185033 Nov 24 03:18:37.218552 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 537/1101] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:18:37 2021] GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:18:38.234952 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-40754131-a01d-45dd-b8b7-b81176f3a6c7 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:18:38.235521 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-40754131-a01d-45dd-b8b7-b81176f3a6c7 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:18:38.242484 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-40754131-a01d-45dd-b8b7-b81176f3a6c7 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:38.242929 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-40754131-a01d-45dd-b8b7-b81176f3a6c7 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:38.243707 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-40754131-a01d-45dd-b8b7-b81176f3a6c7 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:38.244137 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-40754131-a01d-45dd-b8b7-b81176f3a6c7 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:38.397198 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-40754131-a01d-45dd-b8b7-b81176f3a6c7 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:18:38.408659 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-40754131-a01d-45dd-b8b7-b81176f3a6c7 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 200 len: 1265 microversion: 2.1 time: 0.177287 Nov 24 03:18:38.409317 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 565/1102] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:18:38 2021] GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:18:39.430513 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f47adade-f37b-4eac-a09c-922ff4143a06 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:18:39.431284 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f47adade-f37b-4eac-a09c-922ff4143a06 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:18:39.438329 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f47adade-f37b-4eac-a09c-922ff4143a06 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:39.438759 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f47adade-f37b-4eac-a09c-922ff4143a06 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:39.439543 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f47adade-f37b-4eac-a09c-922ff4143a06 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:39.439973 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f47adade-f37b-4eac-a09c-922ff4143a06 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:39.586736 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f47adade-f37b-4eac-a09c-922ff4143a06 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:18:39.594770 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f47adade-f37b-4eac-a09c-922ff4143a06 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 200 len: 1265 microversion: 2.1 time: 0.167980 Nov 24 03:18:39.595371 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 538/1103] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:18:39 2021] GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:18:40.612403 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-8079a456-b6d9-43f4-aee6-6bdda8576fd4 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:18:40.613053 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-8079a456-b6d9-43f4-aee6-6bdda8576fd4 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:18:40.619530 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8079a456-b6d9-43f4-aee6-6bdda8576fd4 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:40.619990 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8079a456-b6d9-43f4-aee6-6bdda8576fd4 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:40.620766 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8079a456-b6d9-43f4-aee6-6bdda8576fd4 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:40.621199 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-8079a456-b6d9-43f4-aee6-6bdda8576fd4 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:40.767580 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-8079a456-b6d9-43f4-aee6-6bdda8576fd4 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:18:40.775978 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-8079a456-b6d9-43f4-aee6-6bdda8576fd4 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 200 len: 1265 microversion: 2.1 time: 0.167656 Nov 24 03:18:40.776520 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 566/1104] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:18:40 2021] GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:18:41.795751 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-70a824fe-ffd1-467c-9898-7a72f90140ee tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:18:41.796656 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-70a824fe-ffd1-467c-9898-7a72f90140ee tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:18:41.806117 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-70a824fe-ffd1-467c-9898-7a72f90140ee tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:41.806790 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-70a824fe-ffd1-467c-9898-7a72f90140ee tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:41.807910 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-70a824fe-ffd1-467c-9898-7a72f90140ee tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:41.808592 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-70a824fe-ffd1-467c-9898-7a72f90140ee tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:41.962322 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-70a824fe-ffd1-467c-9898-7a72f90140ee tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:18:41.973787 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-70a824fe-ffd1-467c-9898-7a72f90140ee tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 200 len: 1265 microversion: 2.1 time: 0.183294 Nov 24 03:18:41.974588 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 539/1105] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:18:41 2021] GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:18:42.997156 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-b6024dbc-1ac3-4cd5-b7a7-0f7b906b96ab tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:18:42.997883 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-b6024dbc-1ac3-4cd5-b7a7-0f7b906b96ab tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:18:43.004901 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b6024dbc-1ac3-4cd5-b7a7-0f7b906b96ab tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:43.005401 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b6024dbc-1ac3-4cd5-b7a7-0f7b906b96ab tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:43.006271 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b6024dbc-1ac3-4cd5-b7a7-0f7b906b96ab tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:43.007003 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-b6024dbc-1ac3-4cd5-b7a7-0f7b906b96ab tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:43.328719 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-b6024dbc-1ac3-4cd5-b7a7-0f7b906b96ab tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:18:43.338925 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-b6024dbc-1ac3-4cd5-b7a7-0f7b906b96ab tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 200 len: 1265 microversion: 2.1 time: 0.347545 Nov 24 03:18:43.339682 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 567/1106] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:18:42 2021] GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 1265 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:18:44.358262 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c2a4562e-31cf-4783-8a74-cefc470d3e78 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:18:44.358884 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c2a4562e-31cf-4783-8a74-cefc470d3e78 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:18:44.365668 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2a4562e-31cf-4783-8a74-cefc470d3e78 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:44.366159 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2a4562e-31cf-4783-8a74-cefc470d3e78 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:44.366946 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2a4562e-31cf-4783-8a74-cefc470d3e78 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:44.367385 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2a4562e-31cf-4783-8a74-cefc470d3e78 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:44.516891 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c2a4562e-31cf-4783-8a74-cefc470d3e78 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:18:44.525835 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c2a4562e-31cf-4783-8a74-cefc470d3e78 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 200 len: 1265 microversion: 2.1 time: 0.171277 Nov 24 03:18:44.526461 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 540/1107] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:18:44 2021] GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:18:45.543083 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-cd5087b9-63e1-4cbc-8b60-9d8c9d16acb1 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:18:45.543697 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-cd5087b9-63e1-4cbc-8b60-9d8c9d16acb1 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:18:45.550479 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cd5087b9-63e1-4cbc-8b60-9d8c9d16acb1 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:45.550933 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cd5087b9-63e1-4cbc-8b60-9d8c9d16acb1 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:45.551713 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cd5087b9-63e1-4cbc-8b60-9d8c9d16acb1 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:45.552150 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cd5087b9-63e1-4cbc-8b60-9d8c9d16acb1 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:45.692076 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-cd5087b9-63e1-4cbc-8b60-9d8c9d16acb1 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:18:45.699722 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-cd5087b9-63e1-4cbc-8b60-9d8c9d16acb1 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 200 len: 1265 microversion: 2.1 time: 0.160299 Nov 24 03:18:45.700293 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 568/1108] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:18:45 2021] GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:18:46.716659 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-83363ea4-44f7-474e-8b7a-dd7866df5c1a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:18:46.717279 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-83363ea4-44f7-474e-8b7a-dd7866df5c1a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:18:46.724234 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-83363ea4-44f7-474e-8b7a-dd7866df5c1a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:46.724690 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-83363ea4-44f7-474e-8b7a-dd7866df5c1a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:46.725497 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-83363ea4-44f7-474e-8b7a-dd7866df5c1a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:46.726015 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-83363ea4-44f7-474e-8b7a-dd7866df5c1a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:46.827950 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [req-7d195186-3e12-44f4-8fb1-85000f70de6c req-1e01f5be-271c-4c2f-a4f8-7bc3ea64a0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d3be288-cb78-479a-b00a-eade919da2e8", "name": "network-vif-plugged", "status": "completed", "tag": "3b0c78e0-aaa4-4182-9969-0e3ee5c921d5"}]} {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:18:46.831310 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:18:46.831310 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: warnings.warn(msg) Nov 24 03:18:46.839967 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-7d195186-3e12-44f4-8fb1-85000f70de6c req-1e01f5be-271c-4c2f-a4f8-7bc3ea64a0a2 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:46.840369 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [req-7d195186-3e12-44f4-8fb1-85000f70de6c req-1e01f5be-271c-4c2f-a4f8-7bc3ea64a0a2 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:46.853093 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.compute.server_external_events [req-7d195186-3e12-44f4-8fb1-85000f70de6c req-1e01f5be-271c-4c2f-a4f8-7bc3ea64a0a2 service nova] Creating event network-vif-plugged:3b0c78e0-aaa4-4182-9969-0e3ee5c921d5 for instance 0d3be288-cb78-479a-b00a-eade919da2e8 on hv-cinder-81803 Nov 24 03:18:46.858573 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [req-7d195186-3e12-44f4-8fb1-85000f70de6c req-1e01f5be-271c-4c2f-a4f8-7bc3ea64a0a2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034980 Nov 24 03:18:46.859665 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 569/1109] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:18:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:18:46.872050 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-83363ea4-44f7-474e-8b7a-dd7866df5c1a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:18:46.880658 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-83363ea4-44f7-474e-8b7a-dd7866df5c1a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 200 len: 1265 microversion: 2.1 time: 0.167562 Nov 24 03:18:46.881163 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 541/1110] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:18:46 2021] GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:18:47.900330 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-64afcc62-a873-4e3c-84c0-f3d0ee67364c tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:18:47.901028 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-64afcc62-a873-4e3c-84c0-f3d0ee67364c tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:18:47.908159 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-64afcc62-a873-4e3c-84c0-f3d0ee67364c tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:47.908159 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-64afcc62-a873-4e3c-84c0-f3d0ee67364c tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:47.909091 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-64afcc62-a873-4e3c-84c0-f3d0ee67364c tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:47.909531 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-64afcc62-a873-4e3c-84c0-f3d0ee67364c tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:48.063752 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-64afcc62-a873-4e3c-84c0-f3d0ee67364c tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:18:48.075624 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-64afcc62-a873-4e3c-84c0-f3d0ee67364c tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 200 len: 1265 microversion: 2.1 time: 0.180162 Nov 24 03:18:48.076391 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 570/1111] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:18:47 2021] GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:18:49.031692 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 03:18:49.032562 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: Wed Nov 24 03:18:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 03:18:49.100050 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-646d54ed-5271-421f-a1e5-798177d0b80a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:18:49.100662 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-646d54ed-5271-421f-a1e5-798177d0b80a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:18:49.107180 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-646d54ed-5271-421f-a1e5-798177d0b80a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:49.107613 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-646d54ed-5271-421f-a1e5-798177d0b80a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:49.108384 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-646d54ed-5271-421f-a1e5-798177d0b80a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:49.108811 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-646d54ed-5271-421f-a1e5-798177d0b80a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:49.255771 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-646d54ed-5271-421f-a1e5-798177d0b80a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:18:49.263252 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-646d54ed-5271-421f-a1e5-798177d0b80a tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 200 len: 1451 microversion: 2.1 time: 0.167178 Nov 24 03:18:49.263827 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 542/1112] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:18:49 2021] GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:18:49.280254 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-2f2d17fa-c786-4b58-8982-3bbdb435df9d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:18:49.280863 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-2f2d17fa-c786-4b58-8982-3bbdb435df9d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:18:49.288013 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2f2d17fa-c786-4b58-8982-3bbdb435df9d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:49.288415 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2f2d17fa-c786-4b58-8982-3bbdb435df9d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:49.289182 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2f2d17fa-c786-4b58-8982-3bbdb435df9d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:49.289609 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-2f2d17fa-c786-4b58-8982-3bbdb435df9d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:49.437263 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-2f2d17fa-c786-4b58-8982-3bbdb435df9d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:18:49.445162 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-2f2d17fa-c786-4b58-8982-3bbdb435df9d tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 200 len: 1451 microversion: 2.1 time: 0.168624 Nov 24 03:18:49.445727 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 571/1113] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:18:49 2021] GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:18:51.534301 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-1fd513fa-e43a-4d8a-a6ec-a87980082a64 req-aabc8a6b-757c-4484-9808-1f4c5a71bd31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d3be288-cb78-479a-b00a-eade919da2e8", "tag": "3b0c78e0-aaa4-4182-9969-0e3ee5c921d5"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:18:51.535799 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:18:51.535799 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:18:51.542737 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-1fd513fa-e43a-4d8a-a6ec-a87980082a64 req-aabc8a6b-757c-4484-9808-1f4c5a71bd31 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:18:51.543183 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-1fd513fa-e43a-4d8a-a6ec-a87980082a64 req-aabc8a6b-757c-4484-9808-1f4c5a71bd31 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:18:51.555626 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-1fd513fa-e43a-4d8a-a6ec-a87980082a64 req-aabc8a6b-757c-4484-9808-1f4c5a71bd31 service nova] Creating event network-changed:3b0c78e0-aaa4-4182-9969-0e3ee5c921d5 for instance 0d3be288-cb78-479a-b00a-eade919da2e8 on hv-cinder-81803 Nov 24 03:18:51.560778 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-1fd513fa-e43a-4d8a-a6ec-a87980082a64 req-aabc8a6b-757c-4484-9808-1f4c5a71bd31 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118758 Nov 24 03:18:51.561381 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 543/1114] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:18:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:20:23.719225 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-48343061-48bf-4eb7-817e-567dc376b8cc tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:20:23.726499 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-9ea65872-8d3d-4971-80a7-5b1a97d8974a req-3acef99b-b213-4629-a93f-495d049f2195 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d3be288-cb78-479a-b00a-eade919da2e8", "tag": "3b0c78e0-aaa4-4182-9969-0e3ee5c921d5"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:20:23.727308 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-48343061-48bf-4eb7-817e-567dc376b8cc tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:20:23.728272 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:20:23.728272 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:20:23.733690 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-48343061-48bf-4eb7-817e-567dc376b8cc tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:23.734347 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-48343061-48bf-4eb7-817e-567dc376b8cc tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:23.735283 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-48343061-48bf-4eb7-817e-567dc376b8cc tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:23.735571 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-9ea65872-8d3d-4971-80a7-5b1a97d8974a req-3acef99b-b213-4629-a93f-495d049f2195 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:23.735740 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-48343061-48bf-4eb7-817e-567dc376b8cc tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:23.736145 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-9ea65872-8d3d-4971-80a7-5b1a97d8974a req-3acef99b-b213-4629-a93f-495d049f2195 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:23.747081 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-9ea65872-8d3d-4971-80a7-5b1a97d8974a req-3acef99b-b213-4629-a93f-495d049f2195 service nova] Creating event network-changed:3b0c78e0-aaa4-4182-9969-0e3ee5c921d5 for instance 0d3be288-cb78-479a-b00a-eade919da2e8 on hv-cinder-81803 Nov 24 03:20:23.752610 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-9ea65872-8d3d-4971-80a7-5b1a97d8974a req-3acef99b-b213-4629-a93f-495d049f2195 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031457 Nov 24 03:20:23.753406 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 544/1115] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:20:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:20:23.763258 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-48343061-48bf-4eb7-817e-567dc376b8cc tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Going to try to terminate instance {{(pid=116331) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:20:23.846898 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-48343061-48bf-4eb7-817e-567dc376b8cc tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 204 len: 0 microversion: 2.1 time: 0.132062 Nov 24 03:20:23.852601 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 572/1116] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:20:23 2021] DELETE /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:20:23.857566 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c9152d26-9e0c-4458-9ae8-d2c6575a5531 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:20:23.858448 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c9152d26-9e0c-4458-9ae8-d2c6575a5531 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:20:23.867275 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c9152d26-9e0c-4458-9ae8-d2c6575a5531 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:23.867763 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c9152d26-9e0c-4458-9ae8-d2c6575a5531 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:23.868569 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c9152d26-9e0c-4458-9ae8-d2c6575a5531 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:23.869012 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c9152d26-9e0c-4458-9ae8-d2c6575a5531 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:24.152654 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c9152d26-9e0c-4458-9ae8-d2c6575a5531 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:20:24.161005 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c9152d26-9e0c-4458-9ae8-d2c6575a5531 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 200 len: 1576 microversion: 2.1 time: 0.308684 Nov 24 03:20:24.161558 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 545/1117] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:20:23 2021] GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 1576 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 03:20:25.179752 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-9b24c63e-c5ea-4fd7-a139-f38e6b8f92c0 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:20:25.180519 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-9b24c63e-c5ea-4fd7-a139-f38e6b8f92c0 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:20:25.187927 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9b24c63e-c5ea-4fd7-a139-f38e6b8f92c0 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:25.188377 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9b24c63e-c5ea-4fd7-a139-f38e6b8f92c0 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:25.189155 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9b24c63e-c5ea-4fd7-a139-f38e6b8f92c0 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:25.189584 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-9b24c63e-c5ea-4fd7-a139-f38e6b8f92c0 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:25.387208 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-9b24c63e-c5ea-4fd7-a139-f38e6b8f92c0 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:20:25.395145 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-9b24c63e-c5ea-4fd7-a139-f38e6b8f92c0 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 200 len: 1457 microversion: 2.1 time: 0.219940 Nov 24 03:20:25.395713 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 573/1118] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:20:25 2021] GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 1457 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:20:25.939490 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-a53a1659-ae9b-428a-95e4-dc6dbe6e0601 req-397eb2c3-de68-4763-b762-12eddc59ed2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d3be288-cb78-479a-b00a-eade919da2e8", "name": "network-vif-deleted", "tag": "3b0c78e0-aaa4-4182-9969-0e3ee5c921d5"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:20:25.940989 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:20:25.940989 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:20:25.948738 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-a53a1659-ae9b-428a-95e4-dc6dbe6e0601 req-397eb2c3-de68-4763-b762-12eddc59ed2d service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:25.949185 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-a53a1659-ae9b-428a-95e4-dc6dbe6e0601 req-397eb2c3-de68-4763-b762-12eddc59ed2d service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:25.960392 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-a53a1659-ae9b-428a-95e4-dc6dbe6e0601 req-397eb2c3-de68-4763-b762-12eddc59ed2d service nova] Creating event network-vif-deleted:3b0c78e0-aaa4-4182-9969-0e3ee5c921d5 for instance 0d3be288-cb78-479a-b00a-eade919da2e8 on hv-cinder-81803 Nov 24 03:20:25.965652 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-a53a1659-ae9b-428a-95e4-dc6dbe6e0601 req-397eb2c3-de68-4763-b762-12eddc59ed2d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083341 Nov 24 03:20:25.966275 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 546/1119] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:20:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:20:26.411765 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-bc1bd7b4-9d78-41a2-a46f-c0dc80f28c76 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:20:26.412346 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-bc1bd7b4-9d78-41a2-a46f-c0dc80f28c76 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:20:26.419019 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bc1bd7b4-9d78-41a2-a46f-c0dc80f28c76 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:26.419466 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bc1bd7b4-9d78-41a2-a46f-c0dc80f28c76 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:26.420237 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bc1bd7b4-9d78-41a2-a46f-c0dc80f28c76 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:26.420663 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bc1bd7b4-9d78-41a2-a46f-c0dc80f28c76 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:26.450676 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bc1bd7b4-9d78-41a2-a46f-c0dc80f28c76 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:26.451115 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-bc1bd7b4-9d78-41a2-a46f-c0dc80f28c76 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:26.451547 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.objects.instance [None req-bc1bd7b4-9d78-41a2-a46f-c0dc80f28c76 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lazy-loading 'fault' on Instance uuid 0d3be288-cb78-479a-b00a-eade919da2e8 {{(pid=116331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:20:26.497807 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-bc1bd7b4-9d78-41a2-a46f-c0dc80f28c76 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:20:26.505691 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-bc1bd7b4-9d78-41a2-a46f-c0dc80f28c76 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 200 len: 1229 microversion: 2.1 time: 0.097775 Nov 24 03:20:26.506433 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 574/1120] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:20:26 2021] GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:20:27.526747 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4454997d-2020-46bb-bf3d-1045083ff65e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:20:27.527331 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4454997d-2020-46bb-bf3d-1045083ff65e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 0d3be288-cb78-479a-b00a-eade919da2e8] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:20:27.534790 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4454997d-2020-46bb-bf3d-1045083ff65e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:27.535232 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4454997d-2020-46bb-bf3d-1045083ff65e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:27.536006 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4454997d-2020-46bb-bf3d-1045083ff65e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:27.536436 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4454997d-2020-46bb-bf3d-1045083ff65e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:27.550866 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-4454997d-2020-46bb-bf3d-1045083ff65e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] HTTP exception thrown: Instance 0d3be288-cb78-479a-b00a-eade919da2e8 could not be found. Nov 24 03:20:27.551443 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4454997d-2020-46bb-bf3d-1045083ff65e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Returning 404 to user: Instance 0d3be288-cb78-479a-b00a-eade919da2e8 could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:20:27.552257 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4454997d-2020-46bb-bf3d-1045083ff65e tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8" status: 404 len: 111 microversion: 2.1 time: 0.031101 Nov 24 03:20:27.552789 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 547/1121] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:20:27 2021] GET /compute/v2.1/servers/0d3be288-cb78-479a-b00a-eade919da2e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:20:30.929641 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-cb195776-7e24-4fe8-94e8-abc027a6abfb tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:20:30.930252 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-cb195776-7e24-4fe8-94e8-abc027a6abfb tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:20:30.935432 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-c6b3dffd-4e34-4a1a-90b7-96eef4951a44 req-223a3a64-f28c-48d1-883d-af2b3a7be430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67c4d17c-c67b-430a-8016-ecac413d507b", "tag": "f1dc8eb1-f99a-4e83-9f9b-91c639f8b9cf"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:20:30.936917 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:20:30.936917 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:20:30.946638 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb195776-7e24-4fe8-94e8-abc027a6abfb tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:30.947090 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb195776-7e24-4fe8-94e8-abc027a6abfb tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:30.947879 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb195776-7e24-4fe8-94e8-abc027a6abfb tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:30.948325 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-cb195776-7e24-4fe8-94e8-abc027a6abfb tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:30.954003 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-c6b3dffd-4e34-4a1a-90b7-96eef4951a44 req-223a3a64-f28c-48d1-883d-af2b3a7be430 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:30.954477 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-c6b3dffd-4e34-4a1a-90b7-96eef4951a44 req-223a3a64-f28c-48d1-883d-af2b3a7be430 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:30.966920 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-c6b3dffd-4e34-4a1a-90b7-96eef4951a44 req-223a3a64-f28c-48d1-883d-af2b3a7be430 service nova] Creating event network-changed:f1dc8eb1-f99a-4e83-9f9b-91c639f8b9cf for instance 67c4d17c-c67b-430a-8016-ecac413d507b on hv-cinder-81803 Nov 24 03:20:30.972737 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-c6b3dffd-4e34-4a1a-90b7-96eef4951a44 req-223a3a64-f28c-48d1-883d-af2b3a7be430 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040923 Nov 24 03:20:30.973518 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 548/1122] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:20:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:20:30.988250 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-cb195776-7e24-4fe8-94e8-abc027a6abfb tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Going to try to terminate instance {{(pid=116331) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 03:20:31.074750 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-cb195776-7e24-4fe8-94e8-abc027a6abfb tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "DELETE /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 204 len: 0 microversion: 2.1 time: 0.148164 Nov 24 03:20:31.075840 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 575/1123] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:20:30 2021] DELETE /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 03:20:31.085355 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f6c0a472-4844-4e32-b291-c986b422110b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:20:31.086136 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f6c0a472-4844-4e32-b291-c986b422110b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:20:31.092588 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f6c0a472-4844-4e32-b291-c986b422110b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:31.093044 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f6c0a472-4844-4e32-b291-c986b422110b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:31.093831 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f6c0a472-4844-4e32-b291-c986b422110b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:31.094291 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f6c0a472-4844-4e32-b291-c986b422110b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:31.304341 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f6c0a472-4844-4e32-b291-c986b422110b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:20:31.312448 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f6c0a472-4844-4e32-b291-c986b422110b tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 200 len: 1576 microversion: 2.1 time: 0.232139 Nov 24 03:20:31.313024 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 549/1124] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:20:31 2021] GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 1576 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:20:32.332161 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-da8e7d6c-8cf2-4ded-aa82-92cc33446c67 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:20:32.332749 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-da8e7d6c-8cf2-4ded-aa82-92cc33446c67 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:20:32.340254 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-da8e7d6c-8cf2-4ded-aa82-92cc33446c67 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:32.340708 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-da8e7d6c-8cf2-4ded-aa82-92cc33446c67 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:32.341504 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-da8e7d6c-8cf2-4ded-aa82-92cc33446c67 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:32.341943 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-da8e7d6c-8cf2-4ded-aa82-92cc33446c67 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:32.491413 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-da8e7d6c-8cf2-4ded-aa82-92cc33446c67 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:20:32.499092 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-da8e7d6c-8cf2-4ded-aa82-92cc33446c67 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 200 len: 1457 microversion: 2.1 time: 0.171117 Nov 24 03:20:32.499660 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 576/1125] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:20:32 2021] GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 1457 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:20:33.066814 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-9c5ded5d-406c-4c39-8723-34cc35c2d3a2 req-aadb8381-aa35-44af-9e66-643793744853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67c4d17c-c67b-430a-8016-ecac413d507b", "name": "network-vif-deleted", "tag": "f1dc8eb1-f99a-4e83-9f9b-91c639f8b9cf"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 03:20:33.068366 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 03:20:33.068366 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Nov 24 03:20:33.079336 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-9c5ded5d-406c-4c39-8723-34cc35c2d3a2 req-aadb8381-aa35-44af-9e66-643793744853 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:33.079779 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-9c5ded5d-406c-4c39-8723-34cc35c2d3a2 req-aadb8381-aa35-44af-9e66-643793744853 service nova] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:33.091821 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-9c5ded5d-406c-4c39-8723-34cc35c2d3a2 req-aadb8381-aa35-44af-9e66-643793744853 service nova] Creating event network-vif-deleted:f1dc8eb1-f99a-4e83-9f9b-91c639f8b9cf for instance 67c4d17c-c67b-430a-8016-ecac413d507b on hv-cinder-81803 Nov 24 03:20:33.097098 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-9c5ded5d-406c-4c39-8723-34cc35c2d3a2 req-aadb8381-aa35-44af-9e66-643793744853 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033957 Nov 24 03:20:33.097691 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 550/1126] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Nov 24 03:20:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 03:20:33.516708 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-087abfab-99ee-44aa-a83a-006f3bcd42b3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:20:33.517289 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-087abfab-99ee-44aa-a83a-006f3bcd42b3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:20:33.524247 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-087abfab-99ee-44aa-a83a-006f3bcd42b3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:33.524884 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-087abfab-99ee-44aa-a83a-006f3bcd42b3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:33.525659 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-087abfab-99ee-44aa-a83a-006f3bcd42b3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:33.526128 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-087abfab-99ee-44aa-a83a-006f3bcd42b3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:33.556632 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-087abfab-99ee-44aa-a83a-006f3bcd42b3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:33.557071 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-087abfab-99ee-44aa-a83a-006f3bcd42b3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:33.557508 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.objects.instance [None req-087abfab-99ee-44aa-a83a-006f3bcd42b3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lazy-loading 'fault' on Instance uuid 67c4d17c-c67b-430a-8016-ecac413d507b {{(pid=116331) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 03:20:33.598858 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.policy [None req-087abfab-99ee-44aa-a83a-006f3bcd42b3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b561b6a5dd4b989eea3738020c5601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc916a12ffa6450da0f5411cbeced892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116331) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 03:20:33.607261 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-087abfab-99ee-44aa-a83a-006f3bcd42b3 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 200 len: 1229 microversion: 2.1 time: 0.094679 Nov 24 03:20:33.607870 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 577/1127] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:20:33 2021] GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 03:20:34.630478 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3f9c520c-af49-423a-9b91-7fa15fc15420 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:20:34.631639 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3f9c520c-af49-423a-9b91-7fa15fc15420 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 67c4d17c-c67b-430a-8016-ecac413d507b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:20:34.642836 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f9c520c-af49-423a-9b91-7fa15fc15420 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:34.643474 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f9c520c-af49-423a-9b91-7fa15fc15420 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:34.644677 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f9c520c-af49-423a-9b91-7fa15fc15420 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:34.645313 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f9c520c-af49-423a-9b91-7fa15fc15420 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:34.666394 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-3f9c520c-af49-423a-9b91-7fa15fc15420 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] HTTP exception thrown: Instance 67c4d17c-c67b-430a-8016-ecac413d507b could not be found. Nov 24 03:20:34.666986 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3f9c520c-af49-423a-9b91-7fa15fc15420 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Returning 404 to user: Instance 67c4d17c-c67b-430a-8016-ecac413d507b could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:20:34.667820 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3f9c520c-af49-423a-9b91-7fa15fc15420 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b" status: 404 len: 111 microversion: 2.1 time: 0.044930 Nov 24 03:20:34.668360 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 551/1128] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:20:34 2021] GET /compute/v2.1/servers/67c4d17c-c67b-430a-8016-ecac413d507b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:20:35.137146 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c9bb47ef-e3cb-4d49-994a-be3967860bb5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:20:35.137680 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.compute.api [None req-c9bb47ef-e3cb-4d49-994a-be3967860bb5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116331) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:20:35.144714 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c9bb47ef-e3cb-4d49-994a-be3967860bb5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:35.145162 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c9bb47ef-e3cb-4d49-994a-be3967860bb5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:35.145965 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c9bb47ef-e3cb-4d49-994a-be3967860bb5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:35.146401 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG oslo_concurrency.lockutils [None req-c9bb47ef-e3cb-4d49-994a-be3967860bb5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:35.159743 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.wsgi [None req-c9bb47ef-e3cb-4d49-994a-be3967860bb5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] HTTP exception thrown: Instance 88b3505d-83b9-42cc-970d-f0feda420936 could not be found. Nov 24 03:20:35.160318 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-c9bb47ef-e3cb-4d49-994a-be3967860bb5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Returning 404 to user: Instance 88b3505d-83b9-42cc-970d-f0feda420936 could not be found. {{(pid=116331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:20:35.161135 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-c9bb47ef-e3cb-4d49-994a-be3967860bb5 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "DELETE /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 404 len: 111 microversion: 2.1 time: 0.028166 Nov 24 03:20:35.161681 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 578/1129] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Nov 24 03:20:35 2021] DELETE /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:20:35.170243 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-66eae600-8052-41b5-841c-f248f7dcb132 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:20:35.170869 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-66eae600-8052-41b5-841c-f248f7dcb132 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [instance: 88b3505d-83b9-42cc-970d-f0feda420936] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 03:20:35.177061 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66eae600-8052-41b5-841c-f248f7dcb132 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:35.177506 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66eae600-8052-41b5-841c-f248f7dcb132 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:35.178326 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66eae600-8052-41b5-841c-f248f7dcb132 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 03:20:35.178761 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66eae600-8052-41b5-841c-f248f7dcb132 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Lock "7bf0cf92-00d1-4d68-9678-23382842fbe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 03:20:35.192162 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-66eae600-8052-41b5-841c-f248f7dcb132 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] HTTP exception thrown: Instance 88b3505d-83b9-42cc-970d-f0feda420936 could not be found. Nov 24 03:20:35.192747 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-66eae600-8052-41b5-841c-f248f7dcb132 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Returning 404 to user: Instance 88b3505d-83b9-42cc-970d-f0feda420936 could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 03:20:35.193566 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-66eae600-8052-41b5-841c-f248f7dcb132 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936" status: 404 len: 111 microversion: 2.1 time: 0.027173 Nov 24 03:20:35.194096 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 552/1130] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Nov 24 03:20:35 2021] GET /compute/v2.1/servers/88b3505d-83b9-42cc-970d-f0feda420936 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 03:20:36.499794 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: DEBUG nova.api.openstack.wsgi [None req-08a9994a-2e3b-42d3-a03c-a6fcdac342c2 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] Calling method '.version_select at 0x7f7a2dc2caf0>' {{(pid=116331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 03:20:36.503139 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: ERROR oslo.messaging._drivers.impl_rabbit [None req-08a9994a-2e3b-42d3-a03c-a6fcdac342c2 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [d5305a5f-0d16-4430-822c-9e823348d3d7] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 24 03:20:37.529328 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO oslo.messaging._drivers.impl_rabbit [None req-08a9994a-2e3b-42d3-a03c-a6fcdac342c2 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] [d5305a5f-0d16-4430-822c-9e823348d3d7] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56740. Nov 24 03:20:37.551175 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO nova.api.openstack.requestlog [None req-08a9994a-2e3b-42d3-a03c-a6fcdac342c2 tempest-TestVolumeBootPattern-1930597040 tempest-TestVolumeBootPattern-1930597040-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-855909436" status: 202 len: 0 microversion: 2.1 time: 1.055132 Nov 24 03:20:37.551751 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: [pid: 116331|app: 0|req: 579/1131] 10.222.0.52 () {58 vars in 1259 bytes} [Wed Nov 24 03:20:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-855909436 => generated 0 bytes in 1056 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 03:21:06.270523 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 03:21:06.271088 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: Wed Nov 24 03:21:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 03:22:09.050556 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 03:22:09.051536 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: Wed Nov 24 03:22:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 03:22:53.511409 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 03:22:53.512363 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: Wed Nov 24 03:22:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 03:23:50.926229 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 03:23:50.927383 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: Wed Nov 24 03:23:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 03:24:26.289092 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 03:24:26.290143 dv-cinder-818037-6-iscsi devstack@n-api.service[116330]: Wed Nov 24 03:24:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 03:25:29.077650 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 03:25:29.078692 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: Wed Nov 24 03:25:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 03:25:41.584842 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 03:25:41.585887 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: Wed Nov 24 03:25:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 03:25:50.513503 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 03:25:50.514970 dv-cinder-818037-6-iscsi devstack@n-api.service[116331]: Wed Nov 24 03:25:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!